-- Logs begin at Thu 2022-09-01 15:02:50 UTC, end at Thu 2022-09-01 15:51:42 UTC. -- Sep 01 15:28:29.615605 dv-cinder-852210-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 15:28:29.626381 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 15:28:29 2022] *** Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: nodename: dv-cinder-852210-8-iscsi Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: machine: x86_64 Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: clock source: unix Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: pcre jit disabled Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: detected number of CPU cores: 4 Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: current working directory: / Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: detected binary path: /usr/bin/uwsgi-core Sep 01 15:28:29.628437 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: your processes number limit is 47680 Sep 01 15:28:29.629025 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: your memory page size is 4096 bytes Sep 01 15:28:29.629025 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: detected max file descriptor number: 2048 Sep 01 15:28:29.629025 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: lock engine: pthread robust mutexes Sep 01 15:28:29.629025 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: thunder lock: enabled Sep 01 15:28:29.629025 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 15:28:29.629025 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 15:28:29.668639 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: Python main interpreter initialized at 0x55b743a179c0 Sep 01 15:28:29.668639 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: python threads support enabled Sep 01 15:28:29.668639 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: your server socket listen backlog is limited to 100 connections Sep 01 15:28:29.668639 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: your mercy for graceful operations on workers is 90 seconds Sep 01 15:28:29.669026 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 15:28:29.669105 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: *** Operational MODE: preforking *** Sep 01 15:28:29.671808 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: *** uWSGI is running in multiple interpreter mode *** Sep 01 15:28:29.671808 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: spawned uWSGI master process (pid: 81732) Sep 01 15:28:29.671808 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: spawned uWSGI worker 1 (pid: 81745, cores: 1) Sep 01 15:28:29.671808 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: spawned uWSGI worker 2 (pid: 81746, cores: 1) Sep 01 15:28:29.671808 dv-cinder-852210-8-iscsi devstack@keystone.service[81732]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 15:28:29.669610 dv-cinder-852210-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 01 15:28:33.964597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 15:28:33.964597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: from cryptography.utils import int_from_bytes Sep 01 15:28:33.965250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 15:28:33.965250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: from cryptography.utils import int_from_bytes Sep 01 15:28:33.965694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 15:28:33.965694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: from cryptography.utils import int_from_bytes Sep 01 15:28:33.965825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 15:28:33.965825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: from cryptography.utils import int_from_bytes Sep 01 15:28:34.014496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 15:28:34.014693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 15:28:34.014883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] command line args: [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 15:28:34.015155 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 15:28:34.015242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 15:28:34.015324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ================================================================================ {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 15:28:34.015407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 15:28:34.015546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] command line args: [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 15:28:34.015621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] admin_token = **** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.015843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] config_dir = [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.015933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 15:28:34.016013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ================================================================================ {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 15:28:34.016083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.016207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] config_source = [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.016283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] admin_token = **** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.016388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] debug = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.016507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] config_dir = [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.016591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.016820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.016889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] config_source = [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.016946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] debug = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017355 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] list_limit = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.017903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] log_config_append = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] log_dir = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] list_limit = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] log_file = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] log_config_append = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.018895 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] log_dir = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] log_file = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.019955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.020902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021126 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021264 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.021998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.022400 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.022518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.022739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.022857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.023594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] publish_errors = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.023741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.023860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.024011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.024126 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] publish_errors = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.024271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.024378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.024484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.024626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.024733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.024891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] standard_threads = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] standard_threads = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025807 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] use_journal = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.025917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] use_json = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] use_stderr = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] use_syslog = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] use_journal = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] use_json = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] use_stderr = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.026853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] use_syslog = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.026924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.026993 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 15:28:34.027074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.027176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.027257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.027328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.027457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.027542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.027698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.027801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.027970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.028058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.028211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.028296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.028459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.028567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.028698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.028782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.028947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029029 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029458 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.029985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.030141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.030219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.030382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.030460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.030627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.030705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.030863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.030941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.031113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.031330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.031412 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.031484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.031591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.031675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.031847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.031941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.032106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.032183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.032358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.032441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.032594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.032689 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.032825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.032902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033374 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.033983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.034067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.034215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.034293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.034455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.034537 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.034686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.034771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.034926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.035979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.036133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.036218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.036366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.036444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.036597 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.036672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.036826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.036973 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.037048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.037117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.037275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.037352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.037513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.037607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.037750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.037827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038713 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.038947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.039067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.039188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.039295 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.039418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.039563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.039670 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.039845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.039951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040150 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040579 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040667 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.040898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.041987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.042061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.042227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.042304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.042456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.042539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.042695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.042774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.042933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.043008 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.043188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.043267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.043430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.043515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.043666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.043743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.043924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044007 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044635 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.044955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.045110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.045188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.045345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.045423 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.045593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.045673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.045829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.045906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046299 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.046999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.047077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.047235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.047317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.047498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.047583 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.047738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.047835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048080 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.048937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049400 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.049951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.050088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.050167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.050321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.050406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.050553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.050640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.050791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.050876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.051026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.051116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.051274 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.051361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.051512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.051590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.051763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.051895 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.052020 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] auth.external = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.052162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.052252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.052416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.052538 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.052657 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] auth.external = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.052775 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.052895 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053008 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] auth.password = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] auth.token = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] auth.password = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] auth.token = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.053991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.054649 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.054735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.054897 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.054975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.055143 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.055226 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.055395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.055502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.055621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] credential.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.055798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.055944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.056076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.056207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.056335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.056465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] credential.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.056600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.056739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.056867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.056994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.057122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.057249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.057387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.057523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.057651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.057782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.057909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.058038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.058166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.058303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.058430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.058560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.058689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.058820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.058954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.059091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.059229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.059356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.059484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.059612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.059782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.059943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.060079 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] federation.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.060212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.060344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.060483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.060617 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.060758 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] federation.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.060894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.061038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.061172 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.061304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.061445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.061580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.061712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.061845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.061978 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.062112 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.062253 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.062387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.062520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.062652 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.062786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.062929 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.063070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.063224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.063362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.063495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.063628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.063761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.064016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.064205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.064342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.064476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.064609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.064743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.064898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.065034 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.065168 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.065302 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.065435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.065568 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.065710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.065844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.065976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.066117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.066250 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.066383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.066525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.066660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.066806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.066940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.067074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.067225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.067412 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.067552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.067685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.067873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.068012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.068156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.068299 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.068435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.068567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.068711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.068844 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.068978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.069119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.069254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.069387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.069521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.069653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.069854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.070521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.070657 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.070790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.070924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.071056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.071199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.071342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.071476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.071609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.071742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.071899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.072045 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.072180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.072313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.072447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.072580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.072713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.072860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.073005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.073139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.073281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.073417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.073550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.073691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.073826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.073959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.074098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.074231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.074364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.074506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.074640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.074780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.074924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.075058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.075190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.075332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.075466 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.075600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.075733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.075887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.076022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.076167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.076308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.076443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.076577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.076710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.076853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.076995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.077130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.077264 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.077397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.077530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.077664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.077806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.077940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.078073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.078206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.078339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.078472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.078623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.078758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.078892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.079024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.079157 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.079289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.079431 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.079566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.079700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.079951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.080089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.080231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.080373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.080508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.080651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.080785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.080918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.081051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.081196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.081336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.081469 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.081602 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.081736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.081870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.082011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.082145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.082278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.082409 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.082551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.082684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.082826 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.082962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.083095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.083237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.083371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.083504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.083646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.083796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.083937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.084070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.084203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.084345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.084490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.084625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.084757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.084890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.085025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.085157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.085298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.085460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.085596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.085729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.085861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.085995 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.086137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.086281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.086415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.086548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.086680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.086812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.086954 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.087088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.087222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.087222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.087473 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.087605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.087746 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.087930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.088066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.088066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.088329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.088329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.088591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] resource.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.088726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.088858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.088990 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] resource.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.089123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.089256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.089397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.089531 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.089663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.089796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.089937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.090078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.090213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.090346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.090478 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.090611 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.090742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.090948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.091084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.091084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] role.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.091336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.091336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.091587 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] role.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.091728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] role.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.091897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.092033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] role.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.092167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.092301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.092434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.092581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.092717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.092850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.092983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.093116 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.093258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.093402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.093537 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.093679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.093813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.093953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.094098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.094247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.094387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.094527 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.094665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.094805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.094945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.095093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.095233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.095374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.095514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.095671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.095873 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.096029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.096171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.096310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.096449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.096591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.096730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.096878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.097018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.097158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.097297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.097443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.097602 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.097743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.097882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.098022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.098161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.098300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.098448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.098590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.098729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.098868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.099006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.099006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.099279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.099279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.099554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.099694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.099853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.099995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.100146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.100287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.100426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.100565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.100706 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.100845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.101013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.101169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.101310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] token.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.101459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.101598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.101739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] token.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.101886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.102027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.102165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.102310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.102449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.102588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.102734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.102875 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.103014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.103160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.103317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.103458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.103608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.103749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.103917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.104058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.104198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.104337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.104487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.104629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.104767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.104907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.105047 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.105186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.105348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.105489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.105628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.105780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.105931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.106072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.106221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.106370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.106511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.connection = **** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.106676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.106863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.107008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.connection = **** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.107147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.107286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.107436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.107586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.107727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.107926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.108069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.108209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.108348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.108500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.108641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.108781 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.108921 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.109063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.109202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.109360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.109501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.109662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.109803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.109943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.110084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.110233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.110373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.110514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.110652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.110792 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.110931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.111079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.111221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.111370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.111510 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.111649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.111810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.111810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 15:28:34.112097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.112097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 15:28:34.112097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 15:28:34.131838 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.132074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.132210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.132898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.133039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.133169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.141240 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.141747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.169250 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.169481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.169624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.169860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.223484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.223899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.272618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.272866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.273770 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.274010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.428323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.428552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.428644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.428781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.428892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.429007 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.429090 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.429747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.429829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.429960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.430043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.430176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.453379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.453510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.453596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.453692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.453821 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.453907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.454040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.454124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.454256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.454341 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.454465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.454548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.454675 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.454766 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.465591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.465847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.478999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.479105 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.479189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.479330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.479444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.479564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.479671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.479810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.479910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.480036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.480120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.480255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.480336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.480471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81746) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 15:28:34.497334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.497438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.497543 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 15:28:34.497627 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 15:28:34.497926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.498131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.498215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 15:28:34.498336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 15:28:34.498418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.498612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.498702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.498871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.498954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.499129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.499219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.499385 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.508672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.508771 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.508954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.509037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.509222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.509318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.509506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.509591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.516405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.516496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.519251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.519337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.519539 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.519622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.519843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.519929 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.520133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.520218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.520417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.520511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.520681 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.520771 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.520962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.521065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.521240 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.521347 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.521515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.521623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.521791 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.521901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.522063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.522435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.545329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.545425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.546788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.546871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.547071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.547166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.551585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.551700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.551898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.552012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.552189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.552297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.559147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.559240 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.559438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.559521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.563381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.563468 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.563682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.563766 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.563991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.564086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.564277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.564361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.564554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.564638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.564830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.565104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.565373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.566475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.566774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.567069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.582048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.582325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.582408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.582637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.586309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.586494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.589425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.589609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.589722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.589912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.593870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.594212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.597090 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.597335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.600192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.600417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.600502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.600727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.600811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.601523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.601622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.601814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.601897 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.602100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.602182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.602482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.618279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.618563 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.618647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.618836 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.618918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.619096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.619179 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.619456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.625881 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.626145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.627400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.627811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.628947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.629224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.629343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.629626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.631998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.632297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.632381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.632586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.632670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.632866 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.632949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.633151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.633243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.633441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.644244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.644529 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.644610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.644812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.644908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.645092 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.645176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.645372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.645465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.645650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.645741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.645931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.646014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.646226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.661386 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.661847 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.664817 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.665418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.667653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.668305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.669230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.669735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.670683 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.670976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.671197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.671280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.671484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.671809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.677618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.678315 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.679801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.680344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.682664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.682965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.683188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.683270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.683490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.683583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.683796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.684084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.691311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.691604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.691909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.691993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.692433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.692522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.698628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.698914 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.699202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.699332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81746) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 15:28:34.699478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.699620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.699751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.699931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.700050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.700219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.700338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.700498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.700594 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.700774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.700964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.701048 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.701243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.701327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.701520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.701602 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.701910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.702050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.702132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.702334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.702414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.702628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.702914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81746) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 15:28:34.736364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b743a179c0 pid: 81745 (default app) Sep 01 15:28:34.736837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b743a179c0 pid: 81746 (default app) Sep 01 15:28:34.740035 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4de24-e007-430b-8f19-dbfdbaf2f620 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:34.740405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4de24-e007-430b-8f19-dbfdbaf2f620 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:34.740761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4de24-e007-430b-8f19-dbfdbaf2f620 None None] PATH_INFO: `/v3` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:34.745567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Thu Sep 1 15:28:34 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:41.303905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8623-e362-448e-a8a2-59d6b03dcd1a None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:41.304413 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8623-e362-448e-a8a2-59d6b03dcd1a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:41.304851 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8623-e362-448e-a8a2-59d6b03dcd1a None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:41.309175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:28:41.314369 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:41.314863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:41.314963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:41.386716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: INFO dbcounter [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] Registered counter for database keystone Sep 01 15:28:41.406090 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG oslo_db.sqlalchemy.engines [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 15:28:41.412203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writer thread running {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 15:28:41.587962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG passlib.handlers.bcrypt [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81745) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 15:28:41.588269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG passlib.handlers.bcrypt [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81745) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 15:28:41.645835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:41.647690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:41.774832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 15:28:42.256597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c8623-e362-448e-a8a2-59d6b03dcd1a None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:42.326828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: INFO dbcounter [None req-370c8623-e362-448e-a8a2-59d6b03dcd1a None None] Registered counter for database keystone Sep 01 15:28:42.347948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG oslo_db.sqlalchemy.engines [None req-370c8623-e362-448e-a8a2-59d6b03dcd1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 15:28:42.354451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writer thread running {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 15:28:42.473833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c8623-e362-448e-a8a2-59d6b03dcd1a None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:42.478124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4f84e-d2c1-4ab1-b5a3-bf76a42932a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:42.478744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f84e-d2c1-4ab1-b5a3-bf76a42932a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:42.479026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f84e-d2c1-4ab1-b5a3-bf76a42932a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:42.479297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f84e-d2c1-4ab1-b5a3-bf76a42932a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:42.487235 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4f84e-d2c1-4ab1-b5a3-bf76a42932a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:42.540581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING keystone.common.rbac_enforcer.enforcer [None req-baa4f84e-d2c1-4ab1-b5a3-bf76a42932a7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 15:28:42.540869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4f84e-d2c1-4ab1-b5a3-bf76a42932a7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:42.550199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Thu Sep 1 15:28:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 15:28:42.556677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:42.571221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5292685-efc8-4f0e-8e6d-2fb0b4790427 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:42.575586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf94bde-4923-4252-901d-e1e51dfc3339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:42.576713 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94bde-4923-4252-901d-e1e51dfc3339 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:42.576996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94bde-4923-4252-901d-e1e51dfc3339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:42.577269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf94bde-4923-4252-901d-e1e51dfc3339 admin admin] PATH_INFO: `/v3/projects/9f45f1f2851042af834bdbb9f604e393` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:42.578813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf94bde-4923-4252-901d-e1e51dfc3339 admin admin] RBAC: Authorizing `identity:get_project(project_id=9f45f1f2851042af834bdbb9f604e393)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:42.633199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6cf94bde-4923-4252-901d-e1e51dfc3339 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 15:28:42.633540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf94bde-4923-4252-901d-e1e51dfc3339 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:42.637994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Thu Sep 1 15:28:42 2022] GET /identity/v3/projects/9f45f1f2851042af834bdbb9f604e393 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:44.504000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6399-039f-4d3f-a93d-9f58ac974fdc None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:44.504517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6399-039f-4d3f-a93d-9f58ac974fdc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:44.504600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e6399-039f-4d3f-a93d-9f58ac974fdc None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:44.508933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:28:44.514196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea57d-3373-4ca5-8976-7d3e2436effc None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:44.514612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea57d-3373-4ca5-8976-7d3e2436effc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:44.514743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea57d-3373-4ca5-8976-7d3e2436effc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:44.535277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-08fea57d-3373-4ca5-8976-7d3e2436effc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:44.536800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-08fea57d-3373-4ca5-8976-7d3e2436effc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:44.545189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 15:28:44.810528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6399-039f-4d3f-a93d-9f58ac974fdc None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:44.822783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e6399-039f-4d3f-a93d-9f58ac974fdc None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:44.827202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcd3db-3ef7-49a2-8047-4965e1eec156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:44.827831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd3db-3ef7-49a2-8047-4965e1eec156 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:44.828116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd3db-3ef7-49a2-8047-4965e1eec156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:44.828389 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd3db-3ef7-49a2-8047-4965e1eec156 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:44.836417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcd3db-3ef7-49a2-8047-4965e1eec156 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:44.838223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcd3db-3ef7-49a2-8047-4965e1eec156 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:44.846958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Thu Sep 1 15:28:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:28:44.853215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea57d-3373-4ca5-8976-7d3e2436effc None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:44.862404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea57d-3373-4ca5-8976-7d3e2436effc None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:44.866767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213aab0-0e93-44c6-974c-6397ab2c47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:44.867402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213aab0-0e93-44c6-974c-6397ab2c47e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:44.867687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213aab0-0e93-44c6-974c-6397ab2c47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:44.867991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213aab0-0e93-44c6-974c-6397ab2c47e2 admin admin] PATH_INFO: `/v3/users/4c5eeca39d48419987d8ddcfee675e48` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:44.869309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213aab0-0e93-44c6-974c-6397ab2c47e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c5eeca39d48419987d8ddcfee675e48)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:44.872414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213aab0-0e93-44c6-974c-6397ab2c47e2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:44.873950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Thu Sep 1 15:28:44 2022] GET /identity/v3/users/4c5eeca39d48419987d8ddcfee675e48 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:46.812013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc430a-f7b4-40ae-bf8f-87682b7fc125 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:46.812575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc430a-f7b4-40ae-bf8f-87682b7fc125 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:46.812575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc430a-f7b4-40ae-bf8f-87682b7fc125 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:46.813884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:28:46.819068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85365-f74d-48a5-9d51-a070bbdaa32c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:46.819462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85365-f74d-48a5-9d51-a070bbdaa32c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:46.819735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85365-f74d-48a5-9d51-a070bbdaa32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:46.837918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-aaf85365-f74d-48a5-9d51-a070bbdaa32c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:46.839092 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-aaf85365-f74d-48a5-9d51-a070bbdaa32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:46.879463 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168babf4-4e5f-4f22-91e9-5233bb075da3 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:46.879749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168babf4-4e5f-4f22-91e9-5233bb075da3 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:46.880061 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168babf4-4e5f-4f22-91e9-5233bb075da3 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:46.882073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 6/11] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:28:46.887136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:46.887425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:46.887701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:46.918118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:28:46.928970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG passlib.handlers.bcrypt [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81746) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 15:28:46.929903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG passlib.handlers.bcrypt [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81746) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 15:28:46.978700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:46.980288 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:47.078260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:28:47.186212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85365-f74d-48a5-9d51-a070bbdaa32c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:47.211083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:47.289644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf85365-f74d-48a5-9d51-a070bbdaa32c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:47.322115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ed556-7012-44de-893d-3a7527adf68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:47.322746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ed556-7012-44de-893d-3a7527adf68e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:47.323033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ed556-7012-44de-893d-3a7527adf68e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:47.323312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ed556-7012-44de-893d-3a7527adf68e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:47.334081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ed556-7012-44de-893d-3a7527adf68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:28:47.339251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-083ed556-7012-44de-893d-3a7527adf68e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:28:47.343004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:28:47.343995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:28:47.345037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 7/14] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:28:47.349775 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ed556-7012-44de-893d-3a7527adf68e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:47.430356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:47.439519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35548bde-255b-4d15-a33b-670528aa74dc None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:47.441840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:47.449243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ed556-7012-44de-893d-3a7527adf68e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:47.478118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aff836-96a2-40f7-aaa4-107bc31a85b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:47.478979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff836-96a2-40f7-aaa4-107bc31a85b8 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:47.479270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff836-96a2-40f7-aaa4-107bc31a85b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:47.479549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aff836-96a2-40f7-aaa4-107bc31a85b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:47.482715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:47.483320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:47.483605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:47.483913 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:47.484581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:28:47.484886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:47.486283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:47.498720 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 8/15] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:28:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:28:47.504115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:47.547481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aff836-96a2-40f7-aaa4-107bc31a85b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:47.549748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aff836-96a2-40f7-aaa4-107bc31a85b8 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:47.603100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ead09-158e-4c34-bdb8-7c6931c16093 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:47.636638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce36230-2ade-4d6d-866c-b579b07c1387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:47.637256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce36230-2ade-4d6d-866c-b579b07c1387 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:47.637538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce36230-2ade-4d6d-866c-b579b07c1387 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:47.637815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce36230-2ade-4d6d-866c-b579b07c1387 None admin] PATH_INFO: `/v3/users/4c5eeca39d48419987d8ddcfee675e48` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:47.638944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce36230-2ade-4d6d-866c-b579b07c1387 None admin] RBAC: Authorizing `identity:get_user(user_id=4c5eeca39d48419987d8ddcfee675e48)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:47.640419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce36230-2ade-4d6d-866c-b579b07c1387 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:47.641956 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 9/16] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:28:47 2022] GET /identity/v3/users/4c5eeca39d48419987d8ddcfee675e48 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:28:47.645254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 8/17] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:28:47.647308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce36230-2ade-4d6d-866c-b579b07c1387 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:47.651331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aff836-96a2-40f7-aaa4-107bc31a85b8 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:47.654087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:47.662222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:47.745873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce36230-2ade-4d6d-866c-b579b07c1387 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:47.754979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aff836-96a2-40f7-aaa4-107bc31a85b8 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:47.780278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1d9be-339a-445d-bd61-ccd342cbe538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:47.780913 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1d9be-339a-445d-bd61-ccd342cbe538 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:47.781191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1d9be-339a-445d-bd61-ccd342cbe538 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:47.781466 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1d9be-339a-445d-bd61-ccd342cbe538 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:47.782581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1d9be-339a-445d-bd61-ccd342cbe538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:47.784085 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1d9be-339a-445d-bd61-ccd342cbe538 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:47.785627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:47.791637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:47.791935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1d9be-339a-445d-bd61-ccd342cbe538 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:47.792527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:47.792809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:47.793082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:47.811106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:47.812592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:28:47.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:28:47.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:28:47.832198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:28:47.832198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:28:47.832198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:28:47.832198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:28:47.837593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:47.872594 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:47.891480 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1d9be-339a-445d-bd61-ccd342cbe538 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:47.892024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:47.924869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451b718-7656-411a-9e2d-4aa5b365e4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:47.925483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451b718-7656-411a-9e2d-4aa5b365e4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:47.925768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451b718-7656-411a-9e2d-4aa5b365e4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:47.926045 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451b718-7656-411a-9e2d-4aa5b365e4d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:47.926772 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451b718-7656-411a-9e2d-4aa5b365e4d8 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.domain.id=default, user.id=4c5eeca39d48419987d8ddcfee675e48) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:28:47.927081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451b718-7656-411a-9e2d-4aa5b365e4d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:47.928551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451b718-7656-411a-9e2d-4aa5b365e4d8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:47.935105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1322 bytes} [Thu Sep 1 15:28:47 2022] GET /identity/v3/role_assignments?user.id=4c5eeca39d48419987d8ddcfee675e48&scope.domain.id=default&role.id=32319452053845419798d329f1c194d4 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:28:47.938932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb54d58-dd73-47d3-be5f-fb41dc036ffd None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:47.980133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e4819-3117-4e9e-a41c-8f985256d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:47.980773 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4819-3117-4e9e-a41c-8f985256d236 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:47.981053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4819-3117-4e9e-a41c-8f985256d236 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:47.981325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4819-3117-4e9e-a41c-8f985256d236 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:47.981993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e4819-3117-4e9e-a41c-8f985256d236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:28:47.982300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e4819-3117-4e9e-a41c-8f985256d236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:47.983752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e4819-3117-4e9e-a41c-8f985256d236 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:48.002638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:50.030813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2aee-6375-4834-82aa-d16f6f21fa6d None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.031313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2aee-6375-4834-82aa-d16f6f21fa6d None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.031410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2aee-6375-4834-82aa-d16f6f21fa6d None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:50.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:28:50.038069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40644-a427-48d5-994d-df62d5a962bb None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.038946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40644-a427-48d5-994d-df62d5a962bb None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.039419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40644-a427-48d5-994d-df62d5a962bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:50.063189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-bee40644-a427-48d5-994d-df62d5a962bb None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:50.064787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bee40644-a427-48d5-994d-df62d5a962bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:50.149522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:28:50.445442 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea9ec-d240-4751-aab7-da10835190ac None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.445829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea9ec-d240-4751-aab7-da10835190ac None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.446015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ea9ec-d240-4751-aab7-da10835190ac None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:50.447337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:28:50.463981 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89dd1a-a817-4686-93b8-c57ecd47559a None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.464273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89dd1a-a817-4686-93b8-c57ecd47559a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.464552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89dd1a-a817-4686-93b8-c57ecd47559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:50.471955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2fb3-051c-463b-b3a4-2d91ce4ec99c None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.472249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2fb3-051c-463b-b3a4-2d91ce4ec99c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.472531 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2fb3-051c-463b-b3a4-2d91ce4ec99c None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:50.474110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 14/25] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:28:50.480494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad734f-a3c0-4228-8032-03f03e123753 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.480774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad734f-a3c0-4228-8032-03f03e123753 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.481046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad734f-a3c0-4228-8032-03f03e123753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:50.511804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-0c89dd1a-a817-4686-93b8-c57ecd47559a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:50.513001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0c89dd1a-a817-4686-93b8-c57ecd47559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:50.525055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-65ad734f-a3c0-4228-8032-03f03e123753 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:50.526303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-65ad734f-a3c0-4228-8032-03f03e123753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:50.616126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:50.676657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 12/26] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:28:50.677516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89dd1a-a817-4686-93b8-c57ecd47559a None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:50.679089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 15/27] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:28:50.814540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89dd1a-a817-4686-93b8-c57ecd47559a None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:50.856480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8d371-d5a0-455c-ac78-41b1a71611d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:50.857136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d371-d5a0-455c-ac78-41b1a71611d0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.857420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d371-d5a0-455c-ac78-41b1a71611d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.857694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d371-d5a0-455c-ac78-41b1a71611d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:50.872644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8d371-d5a0-455c-ac78-41b1a71611d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-64e8d371-d5a0-455c-ac78-41b1a71611d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:28:50.879342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:28:50.880190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:28:50.880947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 13/28] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:28:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:28:50.886880 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad734f-a3c0-4228-8032-03f03e123753 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:50.972132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:50.976665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252162-667d-40d5-9907-caf3fbee2bf1 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.977242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252162-667d-40d5-9907-caf3fbee2bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.978110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df252162-667d-40d5-9907-caf3fbee2bf1 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:50.979910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 14/29] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:28:50.997359 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d27b-6ed8-4926-b735-c888488f8956 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:50.997974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d27b-6ed8-4926-b735-c888488f8956 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:50.998454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d27b-6ed8-4926-b735-c888488f8956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.018012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad734f-a3c0-4228-8032-03f03e123753 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:51.037883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-36b1d27b-6ed8-4926-b735-c888488f8956 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:51.039704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-36b1d27b-6ed8-4926-b735-c888488f8956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:51.084137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:51.084784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:51.084964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:51.085236 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.085941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:28:51.086249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:51.087658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:51.100174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 16/30] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:51.101051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:51.102080 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:51.150660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 15/31] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:28:51.151517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1d27b-6ed8-4926-b735-c888488f8956 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:51.224849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6a8f6-0b78-42b0-8036-62c4391b779e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:51.267311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18e0fb-b1d4-4e99-92ac-01c6601dd9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:51.267969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18e0fb-b1d4-4e99-92ac-01c6601dd9dd None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:51.268250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18e0fb-b1d4-4e99-92ac-01c6601dd9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:51.268524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18e0fb-b1d4-4e99-92ac-01c6601dd9dd None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.269213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18e0fb-b1d4-4e99-92ac-01c6601dd9dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:51.270863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18e0fb-b1d4-4e99-92ac-01c6601dd9dd None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:51.277723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:51.293902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1d27b-6ed8-4926-b735-c888488f8956 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:51.337081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:51.337934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:51.338318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:51.338692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.350262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:51.352393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:28:51.369041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:28:51.369933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:28:51.370734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:28:51.370734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:28:51.370734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:28:51.370734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 16/32] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:28:51.371348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:51.411120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:51.490389 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 17/33] 10.222.0.55 () {60 vars in 1131 bytes} [Thu Sep 1 15:28:51 2022] POST /identity/v3/roles => generated 225 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:28:51.491199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18e0fb-b1d4-4e99-92ac-01c6601dd9dd None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:51.508999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22bf83-137f-4f67-ace4-9f334db4a1fd None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:51.592437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9246e-021b-4f36-ad13-e6c07e4f4f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:51.593012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9246e-021b-4f36-ad13-e6c07e4f4f47 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:51.593293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9246e-021b-4f36-ad13-e6c07e4f4f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:51.593567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9246e-021b-4f36-ad13-e6c07e4f4f47 None admin] PATH_INFO: `/v3/users/4c5eeca39d48419987d8ddcfee675e48` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.597253 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9246e-021b-4f36-ad13-e6c07e4f4f47 None admin] RBAC: Authorizing `identity:get_user(user_id=4c5eeca39d48419987d8ddcfee675e48)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:51.599114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9246e-021b-4f36-ad13-e6c07e4f4f47 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:51.600847 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 17/34] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:28:51 2022] GET /identity/v3/users/4c5eeca39d48419987d8ddcfee675e48 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:51.608111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9246e-021b-4f36-ad13-e6c07e4f4f47 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:51.698615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18e0fb-b1d4-4e99-92ac-01c6601dd9dd None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:51.734039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:51.742743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:51.743378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:51.744082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:51.744082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.744669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:28:51.745253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:51.746554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:51.752123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9246e-021b-4f36-ad13-e6c07e4f4f47 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:51.765737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 18/35] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:51.766685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:51.797200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f3556-c11c-4f1f-a7da-bd0bd4d63163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:51.798139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f3556-c11c-4f1f-a7da-bd0bd4d63163 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:51.798564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f3556-c11c-4f1f-a7da-bd0bd4d63163 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:51.798972 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f3556-c11c-4f1f-a7da-bd0bd4d63163 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.799806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f3556-c11c-4f1f-a7da-bd0bd4d63163 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:51.801770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f3556-c11c-4f1f-a7da-bd0bd4d63163 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:51.826269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:51.871588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c837384-1a55-4879-ae48-dc00f9e9c1b5 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:51.907568 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54739010-012e-47ef-b92c-e81888f6c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:51.908242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739010-012e-47ef-b92c-e81888f6c173 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:51.908526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739010-012e-47ef-b92c-e81888f6c173 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:51.908801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739010-012e-47ef-b92c-e81888f6c173 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.910019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54739010-012e-47ef-b92c-e81888f6c173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:51.911476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54739010-012e-47ef-b92c-e81888f6c173 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:51.917882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 19/36] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:28:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:51.917882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384383a-c4a9-4f00-ade4-afc847a7410c None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:51.917882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384383a-c4a9-4f00-ade4-afc847a7410c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:51.917882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384383a-c4a9-4f00-ade4-afc847a7410c None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:51.920552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 20/37] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:28:51.921276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384383a-c4a9-4f00-ade4-afc847a7410c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:51.928952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 18/38] 10.222.0.55 () {60 vars in 1131 bytes} [Thu Sep 1 15:28:51 2022] POST /identity/v3/roles => generated 219 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:28:51.929795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f3556-c11c-4f1f-a7da-bd0bd4d63163 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:52.057460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f3556-c11c-4f1f-a7da-bd0bd4d63163 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:52.069357 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384383a-c4a9-4f00-ade4-afc847a7410c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:52.102111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8b971-de30-4ce1-9eab-5840cfddb483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:52.102835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b971-de30-4ce1-9eab-5840cfddb483 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:52.103124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b971-de30-4ce1-9eab-5840cfddb483 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:52.103491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b971-de30-4ce1-9eab-5840cfddb483 None admin] PATH_INFO: `/v3/domains/default/users/4c5eeca39d48419987d8ddcfee675e48/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:52.105862 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8b971-de30-4ce1-9eab-5840cfddb483 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4c5eeca39d48419987d8ddcfee675e48, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:52.107512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8b971-de30-4ce1-9eab-5840cfddb483 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:52.126212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 19/39] 10.222.0.55 () {58 vars in 1361 bytes} [Thu Sep 1 15:28:51 2022] PUT /identity/v3/domains/default/users/4c5eeca39d48419987d8ddcfee675e48/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:28:52.127751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a2ce-dd94-4f1f-aea4-6ac5d63a9ac9 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:52.128100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a2ce-dd94-4f1f-aea4-6ac5d63a9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:52.128380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5a2ce-dd94-4f1f-aea4-6ac5d63a9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:52.144708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:52.152086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5bd5a2ce-dd94-4f1f-aea4-6ac5d63a9ac9 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:52.154911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5bd5a2ce-dd94-4f1f-aea4-6ac5d63a9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:52.209788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:52.224052 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce0a52-90ed-4b1e-8a01-3009b9420f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:52.224691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce0a52-90ed-4b1e-8a01-3009b9420f6d None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:52.224980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce0a52-90ed-4b1e-8a01-3009b9420f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:52.225259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce0a52-90ed-4b1e-8a01-3009b9420f6d None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:52.225945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce0a52-90ed-4b1e-8a01-3009b9420f6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:52.227442 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce0a52-90ed-4b1e-8a01-3009b9420f6d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:52.242815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 20/40] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:28:52.251841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735430-e10e-4dd0-bad4-7e52dff389c6 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:52.252224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735430-e10e-4dd0-bad4-7e52dff389c6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:52.254373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735430-e10e-4dd0-bad4-7e52dff389c6 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:52.260479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 21/41] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:28:52.265643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7f765-422c-4707-8d88-6675bc6cf511 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:52.266252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7f765-422c-4707-8d88-6675bc6cf511 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:52.266464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 21/42] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:28:51 2022] POST /identity/v3/projects => generated 301 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:28:52.266949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7f765-422c-4707-8d88-6675bc6cf511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:52.290466 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-b0c7f765-422c-4707-8d88-6675bc6cf511 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:52.292025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b0c7f765-422c-4707-8d88-6675bc6cf511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:52.373514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 22/43] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:28:52.524017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce0a52-90ed-4b1e-8a01-3009b9420f6d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:52.626663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce0a52-90ed-4b1e-8a01-3009b9420f6d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:52.644163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7f765-422c-4707-8d88-6675bc6cf511 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:52.661968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7633-c372-48ba-8da6-1bb08226e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:52.662605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7633-c372-48ba-8da6-1bb08226e445 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:52.662893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7633-c372-48ba-8da6-1bb08226e445 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:52.663180 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7633-c372-48ba-8da6-1bb08226e445 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:52.664400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7633-c372-48ba-8da6-1bb08226e445 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:52.665795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7633-c372-48ba-8da6-1bb08226e445 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:52.681882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1131 bytes} [Thu Sep 1 15:28:52 2022] POST /identity/v3/roles => generated 223 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:28:52.720717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:52.761397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7f765-422c-4707-8d88-6675bc6cf511 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:52.798234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f79af8-6102-4e88-b9aa-9187c8ae0854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:52.798814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f79af8-6102-4e88-b9aa-9187c8ae0854 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:52.799100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f79af8-6102-4e88-b9aa-9187c8ae0854 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:52.799379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f79af8-6102-4e88-b9aa-9187c8ae0854 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:52.800614 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f79af8-6102-4e88-b9aa-9187c8ae0854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:52.802201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f79af8-6102-4e88-b9aa-9187c8ae0854 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:52.804042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 23/45] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:28:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:28:52.810142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7633-c372-48ba-8da6-1bb08226e445 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:52.849372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:52.917409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7633-c372-48ba-8da6-1bb08226e445 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:52.949927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff5713-0b65-43e1-884d-f50ecf0efc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:52.950544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff5713-0b65-43e1-884d-f50ecf0efc2a None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:52.950830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff5713-0b65-43e1-884d-f50ecf0efc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:52.951109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff5713-0b65-43e1-884d-f50ecf0efc2a None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:52.951767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff5713-0b65-43e1-884d-f50ecf0efc2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:52.953262 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff5713-0b65-43e1-884d-f50ecf0efc2a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:52.981752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 23/46] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:28:52 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:28:54.103012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bc233-5ea0-4490-8d16-62f182e383b1 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:54.103535 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bc233-5ea0-4490-8d16-62f182e383b1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:54.103641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bc233-5ea0-4490-8d16-62f182e383b1 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:54.105012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 24/47] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:28:54.110326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92b69-252b-4eb0-975d-5f050900b6de None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:54.110748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92b69-252b-4eb0-975d-5f050900b6de None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:54.110882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92b69-252b-4eb0-975d-5f050900b6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:54.129398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-07b92b69-252b-4eb0-975d-5f050900b6de None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:54.130877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-07b92b69-252b-4eb0-975d-5f050900b6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:54.194525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 24/48] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:28:54.458662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bc233-5ea0-4490-8d16-62f182e383b1 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:54.560030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bc233-5ea0-4490-8d16-62f182e383b1 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:54.593446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ae916-40ce-4ee1-bad8-61ed066c9210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:54.594084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ae916-40ce-4ee1-bad8-61ed066c9210 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:54.594369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ae916-40ce-4ee1-bad8-61ed066c9210 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:54.594650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ae916-40ce-4ee1-bad8-61ed066c9210 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:54.596526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:54.606076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ae916-40ce-4ee1-bad8-61ed066c9210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-515ae916-40ce-4ee1-bad8-61ed066c9210 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:28:54.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:28:54.612042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:28:54.613073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 25/49] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:28:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:28:54.617932 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92b69-252b-4eb0-975d-5f050900b6de None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:54.635992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:54.716433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92b69-252b-4eb0-975d-5f050900b6de None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:54.748374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807ba16-fcad-40ca-bf8c-9b544de5c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:54.748985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807ba16-fcad-40ca-bf8c-9b544de5c737 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:54.749268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807ba16-fcad-40ca-bf8c-9b544de5c737 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:54.749540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807ba16-fcad-40ca-bf8c-9b544de5c737 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:54.750198 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807ba16-fcad-40ca-bf8c-9b544de5c737 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:28:54.750500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807ba16-fcad-40ca-bf8c-9b544de5c737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:54.751910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807ba16-fcad-40ca-bf8c-9b544de5c737 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:54.760274 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 25/50] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:28:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:54.765767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ae916-40ce-4ee1-bad8-61ed066c9210 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:54.862512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ae916-40ce-4ee1-bad8-61ed066c9210 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:54.869218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6b45-2cd5-4a95-8190-920b3899f36d None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:54.869552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6b45-2cd5-4a95-8190-920b3899f36d None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:54.869838 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6b45-2cd5-4a95-8190-920b3899f36d None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:54.871188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 26/51] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:28:54.875988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592102-3d1c-4731-adb0-b7dc1efb038b None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:54.876279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592102-3d1c-4731-adb0-b7dc1efb038b None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:54.876558 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592102-3d1c-4731-adb0-b7dc1efb038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:54.894706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ba592102-3d1c-4731-adb0-b7dc1efb038b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:54.895879 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51976fd-c416-4682-b150-161d59618b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:54.896048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ba592102-3d1c-4731-adb0-b7dc1efb038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:54.896515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51976fd-c416-4682-b150-161d59618b90 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:54.896794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51976fd-c416-4682-b150-161d59618b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:54.897069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51976fd-c416-4682-b150-161d59618b90 None admin] PATH_INFO: `/v3/users/4c5eeca39d48419987d8ddcfee675e48` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:54.898989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51976fd-c416-4682-b150-161d59618b90 None admin] RBAC: Authorizing `identity:get_user(user_id=4c5eeca39d48419987d8ddcfee675e48)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:54.900462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51976fd-c416-4682-b150-161d59618b90 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:54.902039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 26/52] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:28:54 2022] GET /identity/v3/users/4c5eeca39d48419987d8ddcfee675e48 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:54.907411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51976fd-c416-4682-b150-161d59618b90 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:54.964552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 27/53] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:28:54.972091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:55.011826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51976fd-c416-4682-b150-161d59618b90 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:55.046509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993773e4-442f-4ac1-bc88-83fe471a57bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:55.047140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993773e4-442f-4ac1-bc88-83fe471a57bb None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:55.047428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993773e4-442f-4ac1-bc88-83fe471a57bb None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:55.047712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993773e4-442f-4ac1-bc88-83fe471a57bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:55.048875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993773e4-442f-4ac1-bc88-83fe471a57bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:55.050333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993773e4-442f-4ac1-bc88-83fe471a57bb None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:55.051910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 27/54] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:28:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:28:55.058183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba592102-3d1c-4731-adb0-b7dc1efb038b None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:55.069904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:55.159141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba592102-3d1c-4731-adb0-b7dc1efb038b None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:55.194352 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:55.195010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:55.195850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:55.196101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:55.196835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.domain.id=default, user.id=4c5eeca39d48419987d8ddcfee675e48) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:28:55.197152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:55.198604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:55.204422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1322 bytes} [Thu Sep 1 15:28:55 2022] GET /identity/v3/role_assignments?user.id=4c5eeca39d48419987d8ddcfee675e48&scope.domain.id=default&role.id=32319452053845419798d329f1c194d4 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:55.227296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993773e4-442f-4ac1-bc88-83fe471a57bb None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:55.437476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993773e4-442f-4ac1-bc88-83fe471a57bb None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:55.465044 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:55.471154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd780ae7-1a02-4634-9ca0-218fb9df5bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:55.471821 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd780ae7-1a02-4634-9ca0-218fb9df5bab None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:55.472115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd780ae7-1a02-4634-9ca0-218fb9df5bab None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:55.472398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd780ae7-1a02-4634-9ca0-218fb9df5bab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:55.473513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd780ae7-1a02-4634-9ca0-218fb9df5bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:55.474990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd780ae7-1a02-4634-9ca0-218fb9df5bab None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:55.476606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 28/56] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:55.482483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:55.555478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:55.579786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eddeb9-b713-41e7-af5a-d4fdd0df522d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:55.611622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcb780-1aa3-4a4c-a53e-2353f1f4772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:55.614097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcb780-1aa3-4a4c-a53e-2353f1f4772e None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:55.614380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcb780-1aa3-4a4c-a53e-2353f1f4772e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:55.614653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcb780-1aa3-4a4c-a53e-2353f1f4772e None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:55.615305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcb780-1aa3-4a4c-a53e-2353f1f4772e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:55.616770 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edcb780-1aa3-4a4c-a53e-2353f1f4772e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:55.641830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 29/57] 10.222.0.55 () {60 vars in 1140 bytes} [Thu Sep 1 15:28:55 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:28:57.526922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f0c4d-84b3-41c4-af2c-4572033f2553 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:57.527427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f0c4d-84b3-41c4-af2c-4572033f2553 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:57.527509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f0c4d-84b3-41c4-af2c-4572033f2553 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:57.528849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 29/58] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:28:57.533829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8d8ce-307c-4700-864b-b33755c864e5 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:57.534260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8d8ce-307c-4700-864b-b33755c864e5 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:57.534385 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8d8ce-307c-4700-864b-b33755c864e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:57.551985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-81b8d8ce-307c-4700-864b-b33755c864e5 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:28:57.553151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-81b8d8ce-307c-4700-864b-b33755c864e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:28:57.615863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 30/59] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:28:57.885414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f0c4d-84b3-41c4-af2c-4572033f2553 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:57.985471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f0c4d-84b3-41c4-af2c-4572033f2553 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:58.017844 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77414e4-57ea-434a-a4cf-fa705fdf6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:58.018474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77414e4-57ea-434a-a4cf-fa705fdf6af7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:58.018763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77414e4-57ea-434a-a4cf-fa705fdf6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:58.019043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77414e4-57ea-434a-a4cf-fa705fdf6af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:58.020188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77414e4-57ea-434a-a4cf-fa705fdf6af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:58.021640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77414e4-57ea-434a-a4cf-fa705fdf6af7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:58.023503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 30/60] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:28:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:28:58.028927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8d8ce-307c-4700-864b-b33755c864e5 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:28:58.082824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:28:58.125793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8d8ce-307c-4700-864b-b33755c864e5 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:28:58.159044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe1e1c-9eb8-4c75-9305-776f85e6999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:28:58.159587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1e1c-9eb8-4c75-9305-776f85e6999c None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:28:58.159898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1e1c-9eb8-4c75-9305-776f85e6999c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:28:58.160175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1e1c-9eb8-4c75-9305-776f85e6999c None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:28:58.160823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe1e1c-9eb8-4c75-9305-776f85e6999c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:28:58.162269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe1e1c-9eb8-4c75-9305-776f85e6999c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:28:58.188197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 31/61] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:28:58 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:01.126808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398c10f-ec6d-4a13-b243-0ee90f3c5c4f None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.127834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398c10f-ec6d-4a13-b243-0ee90f3c5c4f None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.128330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398c10f-ec6d-4a13-b243-0ee90f3c5c4f None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.129874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 31/62] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:01.135856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf892-767e-4d34-b035-c2be45a64678 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.136660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf892-767e-4d34-b035-c2be45a64678 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.137172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf892-767e-4d34-b035-c2be45a64678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.160906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-463bf892-767e-4d34-b035-c2be45a64678 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:01.162145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-463bf892-767e-4d34-b035-c2be45a64678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:01.256454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 32/63] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:01.346731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6675594-7a32-409d-99c6-0f37ea28bf8b None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.347378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6675594-7a32-409d-99c6-0f37ea28bf8b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.347891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6675594-7a32-409d-99c6-0f37ea28bf8b None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.349443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 32/64] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:01.354847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3c9e-4671-42ed-9e75-79a43fb9d8e9 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.355359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3c9e-4671-42ed-9e75-79a43fb9d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.355864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3c9e-4671-42ed-9e75-79a43fb9d8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.384815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-475a3c9e-4671-42ed-9e75-79a43fb9d8e9 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:01.386342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-475a3c9e-4671-42ed-9e75-79a43fb9d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:01.430387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:01.473033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 33/65] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:01.545002 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179a33d-0d37-4a1f-a795-f857089218c4 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.545600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179a33d-0d37-4a1f-a795-f857089218c4 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.546077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179a33d-0d37-4a1f-a795-f857089218c4 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.547933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 33/66] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:01.552916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f090f-8058-4c00-8f73-922f2bec5c85 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.553442 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f090f-8058-4c00-8f73-922f2bec5c85 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.553934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f090f-8058-4c00-8f73-922f2bec5c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.580747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-930f090f-8058-4c00-8f73-922f2bec5c85 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:01.582155 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179a33d-0d37-4a1f-a795-f857089218c4 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:01.595042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-930f090f-8058-4c00-8f73-922f2bec5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:01.702394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:01.735938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 34/67] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:01.764393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179a33d-0d37-4a1f-a795-f857089218c4 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:01.787672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdc2cd-4907-4d04-893f-aa4de1d83a50 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.788693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdc2cd-4907-4d04-893f-aa4de1d83a50 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.789855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdc2cd-4907-4d04-893f-aa4de1d83a50 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.791979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 35/68] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:01.798012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1465a0-8d53-4c1e-9336-5f3234b6c93e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.798829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1465a0-8d53-4c1e-9336-5f3234b6c93e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.799481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1465a0-8d53-4c1e-9336-5f3234b6c93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.835220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-fa1465a0-8d53-4c1e-9336-5f3234b6c93e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:01.836957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-fa1465a0-8d53-4c1e-9336-5f3234b6c93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:01.838001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66da47f-2371-4ea4-b69c-6671db714845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:01.838645 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66da47f-2371-4ea4-b69c-6671db714845 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.838986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66da47f-2371-4ea4-b69c-6671db714845 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.839201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66da47f-2371-4ea4-b69c-6671db714845 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.850111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66da47f-2371-4ea4-b69c-6671db714845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-b66da47f-2371-4ea4-b69c-6671db714845 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:01.855523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:01.856382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:01.857145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:01.858366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb954-1737-40b4-9ebb-1c024820cb15 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:01.858366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb954-1737-40b4-9ebb-1c024820cb15 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:01.858548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb954-1737-40b4-9ebb-1c024820cb15 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:01.859845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 35/70] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:01.864247 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbb954-1737-40b4-9ebb-1c024820cb15 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:01.919362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 36/71] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:01.920545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1465a0-8d53-4c1e-9336-5f3234b6c93e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:01.965401 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:01.986003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbb954-1737-40b4-9ebb-1c024820cb15 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.014148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:02.024855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301bf9e-253f-4fd7-96ce-a0656aff0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.025503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301bf9e-253f-4fd7-96ce-a0656aff0e9c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.025792 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301bf9e-253f-4fd7-96ce-a0656aff0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.026072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301bf9e-253f-4fd7-96ce-a0656aff0e9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.036826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301bf9e-253f-4fd7-96ce-a0656aff0e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d301bf9e-253f-4fd7-96ce-a0656aff0e9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:02.042166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:02.043022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:02.044217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 36/72] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:02.044867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b92f-c708-4eef-add6-9940aeea56e5 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.044867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b92f-c708-4eef-add6-9940aeea56e5 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.045174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b92f-c708-4eef-add6-9940aeea56e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.051829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1465a0-8d53-4c1e-9336-5f3234b6c93e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.062655 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-dec3b92f-c708-4eef-add6-9940aeea56e5 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:02.063947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-dec3b92f-c708-4eef-add6-9940aeea56e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:02.091496 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.092389 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.092671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.093114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.094091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:02.094658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:02.096103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:02.105198 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 37/73] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:02.106010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.137628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 37/74] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:02.149469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b92f-c708-4eef-add6-9940aeea56e5 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.207591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:02.216626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad45bc4-6839-474c-aa47-d3551f1bd52e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.255077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd40fe-5328-45d0-ab34-a30ee21cc06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.255716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd40fe-5328-45d0-ab34-a30ee21cc06e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.256029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd40fe-5328-45d0-ab34-a30ee21cc06e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.256305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd40fe-5328-45d0-ab34-a30ee21cc06e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.266795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b92f-c708-4eef-add6-9940aeea56e5 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.267099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd40fe-5328-45d0-ab34-a30ee21cc06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-e3fd40fe-5328-45d0-ab34-a30ee21cc06e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:02.272446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:02.274158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 38/75] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:02.275596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd40fe-5328-45d0-ab34-a30ee21cc06e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.289272 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:02.309685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.310236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.310518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.310788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.311456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:02.311758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:02.313180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:02.330669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 38/76] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:02.330669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.385534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd40fe-5328-45d0-ab34-a30ee21cc06e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.421509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4b9aa-0c6c-46b4-b456-6c9b2e895c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.422149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b9aa-0c6c-46b4-b456-6c9b2e895c04 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.422430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b9aa-0c6c-46b4-b456-6c9b2e895c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.422706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4b9aa-0c6c-46b4-b456-6c9b2e895c04 None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.426546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528191de-aaec-449f-81b4-352f7485f0be None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.435621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4b9aa-0c6c-46b4-b456-6c9b2e895c04 None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:02.437237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4b9aa-0c6c-46b4-b456-6c9b2e895c04 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:02.438890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 39/77] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:02.439649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4b9aa-0c6c-46b4-b456-6c9b2e895c04 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.454379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:02.461515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860082c2-a34c-4f7a-9d62-a83e2d9662c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.462146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860082c2-a34c-4f7a-9d62-a83e2d9662c9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.462427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860082c2-a34c-4f7a-9d62-a83e2d9662c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.462698 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860082c2-a34c-4f7a-9d62-a83e2d9662c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.463833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860082c2-a34c-4f7a-9d62-a83e2d9662c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:02.465274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860082c2-a34c-4f7a-9d62-a83e2d9662c9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:02.466830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 39/78] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:02.467662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860082c2-a34c-4f7a-9d62-a83e2d9662c9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.512751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:02.542267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4b9aa-0c6c-46b4-b456-6c9b2e895c04 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.567360 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860082c2-a34c-4f7a-9d62-a83e2d9662c9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.575416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.576050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.576336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.576606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.577283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:02.577586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:02.578987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:02.586599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 40/79] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:02.591176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.605402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553055-edfe-4a6e-b11d-08c3fb8d217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.606045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553055-edfe-4a6e-b11d-08c3fb8d217c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.606335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553055-edfe-4a6e-b11d-08c3fb8d217c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.606621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553055-edfe-4a6e-b11d-08c3fb8d217c None admin] PATH_INFO: `/v3/users/4c5eeca39d48419987d8ddcfee675e48` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.607800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e553055-edfe-4a6e-b11d-08c3fb8d217c None admin] RBAC: Authorizing `identity:get_user(user_id=4c5eeca39d48419987d8ddcfee675e48)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:02.609255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e553055-edfe-4a6e-b11d-08c3fb8d217c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:02.610840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 40/80] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/users/4c5eeca39d48419987d8ddcfee675e48 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:02.611607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553055-edfe-4a6e-b11d-08c3fb8d217c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.659697 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:02.684570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda32f9-1235-466b-b3fd-a027093e7c54 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.711015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553055-edfe-4a6e-b11d-08c3fb8d217c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.716936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb3992-eb65-4e8d-b83d-f7ebbfc451a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.717572 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3992-eb65-4e8d-b83d-f7ebbfc451a4 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.717857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3992-eb65-4e8d-b83d-f7ebbfc451a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.718139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3992-eb65-4e8d-b83d-f7ebbfc451a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.724793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:02.728677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb3992-eb65-4e8d-b83d-f7ebbfc451a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-30eb3992-eb65-4e8d-b83d-f7ebbfc451a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:02.733952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:02.734860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:02.735622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 41/81] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:02.736669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb3992-eb65-4e8d-b83d-f7ebbfc451a4 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.746423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc3f5d-33db-4c97-9988-3b8f1269622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.747040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc3f5d-33db-4c97-9988-3b8f1269622f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.747331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc3f5d-33db-4c97-9988-3b8f1269622f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.747607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc3f5d-33db-4c97-9988-3b8f1269622f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.815514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc3f5d-33db-4c97-9988-3b8f1269622f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:02.817046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc3f5d-33db-4c97-9988-3b8f1269622f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:02.834297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb3992-eb65-4e8d-b83d-f7ebbfc451a4 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:02.866087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c223a8-d72d-4266-8fc0-1bff827f5242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:02.866689 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c223a8-d72d-4266-8fc0-1bff827f5242 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:02.867575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c223a8-d72d-4266-8fc0-1bff827f5242 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:02.867886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c223a8-d72d-4266-8fc0-1bff827f5242 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:02.868533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c223a8-d72d-4266-8fc0-1bff827f5242 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:02.869985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c223a8-d72d-4266-8fc0-1bff827f5242 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:02.877871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:02.892691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 42/82] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:02 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:02.893499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c223a8-d72d-4266-8fc0-1bff827f5242 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.930740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 41/83] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:02.931357 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc3f5d-33db-4c97-9988-3b8f1269622f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:02.956770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:03.013163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c223a8-d72d-4266-8fc0-1bff827f5242 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.055678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13f80e-d537-4e8b-8eab-b1c71d4c81a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.056383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13f80e-d537-4e8b-8eab-b1c71d4c81a2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.056672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13f80e-d537-4e8b-8eab-b1c71d4c81a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.056937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13f80e-d537-4e8b-8eab-b1c71d4c81a2 None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:03.058097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13f80e-d537-4e8b-8eab-b1c71d4c81a2 None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:03.059562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13f80e-d537-4e8b-8eab-b1c71d4c81a2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:03.060938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc3f5d-33db-4c97-9988-3b8f1269622f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.061378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 43/84] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:03.061951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13f80e-d537-4e8b-8eab-b1c71d4c81a2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:03.102609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303c921-33a7-49ab-bdd8-b256a81cea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.103610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c921-33a7-49ab-bdd8-b256a81cea75 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.103610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c921-33a7-49ab-bdd8-b256a81cea75 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.103933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c921-33a7-49ab-bdd8-b256a81cea75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:03.128786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:03.185865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13f80e-d537-4e8b-8eab-b1c71d4c81a2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.194804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303c921-33a7-49ab-bdd8-b256a81cea75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:03.196430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303c921-33a7-49ab-bdd8-b256a81cea75 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:03.214221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:03.229975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.231222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.231518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.231894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:03.232509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:03.232816 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:03.234212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:03.244050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 44/85] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:03.248292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:03.325474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 42/86] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:03.326430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303c921-33a7-49ab-bdd8-b256a81cea75 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:03.368272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ef146-2b16-43a6-90d2-fcd2472a3a92 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.389269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:03.406680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a69b13-db7b-43c9-9087-d6f96d8a11a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.407617 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a69b13-db7b-43c9-9087-d6f96d8a11a2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.408112 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a69b13-db7b-43c9-9087-d6f96d8a11a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.408590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a69b13-db7b-43c9-9087-d6f96d8a11a2 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:03.409947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a69b13-db7b-43c9-9087-d6f96d8a11a2 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:03.411606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a69b13-db7b-43c9-9087-d6f96d8a11a2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:03.414335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 45/87] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:03 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:03.415376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a69b13-db7b-43c9-9087-d6f96d8a11a2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:03.451276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303c921-33a7-49ab-bdd8-b256a81cea75 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.469795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:03.497572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3893f-3369-4e23-8bbe-4ecf91273a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.498715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3893f-3369-4e23-8bbe-4ecf91273a2a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.499144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3893f-3369-4e23-8bbe-4ecf91273a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.500482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3893f-3369-4e23-8bbe-4ecf91273a2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:03.532391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a69b13-db7b-43c9-9087-d6f96d8a11a2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.580037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739bf88-6f15-4db3-8e7c-35667713cbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.581206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bf88-6f15-4db3-8e7c-35667713cbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.581633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bf88-6f15-4db3-8e7c-35667713cbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.582049 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739bf88-6f15-4db3-8e7c-35667713cbd2 None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:03.583338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739bf88-6f15-4db3-8e7c-35667713cbd2 None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:03.586402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739bf88-6f15-4db3-8e7c-35667713cbd2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:03.587861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3893f-3369-4e23-8bbe-4ecf91273a2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:03.588802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 46/88] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:03 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:03.589733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739bf88-6f15-4db3-8e7c-35667713cbd2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:03.595334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3893f-3369-4e23-8bbe-4ecf91273a2a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:03.661949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:03.725884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739bf88-6f15-4db3-8e7c-35667713cbd2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.729701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 43/89] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:03.735271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3893f-3369-4e23-8bbe-4ecf91273a2a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:03.750871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:03.774350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a87ff1-b5cc-4c23-818b-2ba2b4b4b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.775340 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a87ff1-b5cc-4c23-818b-2ba2b4b4b988 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.775870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a87ff1-b5cc-4c23-818b-2ba2b4b4b988 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.776344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a87ff1-b5cc-4c23-818b-2ba2b4b4b988 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:03.777696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a87ff1-b5cc-4c23-818b-2ba2b4b4b988 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:03.779927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a87ff1-b5cc-4c23-818b-2ba2b4b4b988 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:03.782674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 47/90] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:03 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:03.783927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a87ff1-b5cc-4c23-818b-2ba2b4b4b988 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:03.846304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3893f-3369-4e23-8bbe-4ecf91273a2a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.881261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.881882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.882165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.882954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:03.883832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] RBAC: Adding query filter params (role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=331fd9a5519d4bd0a191559b4f25947e, user.id=97526bc1651549bcba3b62f593469545) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:03.884151 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:03.885719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:03.903440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 44/91] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:03 2022] GET /identity/v3/role_assignments?user.id=97526bc1651549bcba3b62f593469545&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=4367ece899d646eeb2e2917530897f7f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:03.903440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:03.954849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a87ff1-b5cc-4c23-818b-2ba2b4b4b988 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:03.984413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:03.996995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e0817-9677-4fe2-b127-76de28785784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:03.998019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0817-9677-4fe2-b127-76de28785784 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:03.998435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0817-9677-4fe2-b127-76de28785784 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:03.998853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0817-9677-4fe2-b127-76de28785784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:04.079927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:04.119018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ea287-3dd9-43c3-b5bc-2a74ee88668b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:04.129101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e0817-9677-4fe2-b127-76de28785784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:04.131403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e0817-9677-4fe2-b127-76de28785784 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:04.178007 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedeae7-ad15-432f-ba8f-914fa70e6c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:04.178891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedeae7-ad15-432f-ba8f-914fa70e6c45 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:04.180684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedeae7-ad15-432f-ba8f-914fa70e6c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:04.181141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedeae7-ad15-432f-ba8f-914fa70e6c45 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:04.183807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedeae7-ad15-432f-ba8f-914fa70e6c45 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:04.187513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedeae7-ad15-432f-ba8f-914fa70e6c45 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:04.189817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 45/92] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:03 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:04.196356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedeae7-ad15-432f-ba8f-914fa70e6c45 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:04.268967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 48/93] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:04.270383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e0817-9677-4fe2-b127-76de28785784 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:04.296942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:04.384689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedeae7-ad15-432f-ba8f-914fa70e6c45 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:04.427488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e0817-9677-4fe2-b127-76de28785784 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:04.433246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:04.433868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:04.434154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:04.434429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:04.435169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=331fd9a5519d4bd0a191559b4f25947e, user.id=4c5eeca39d48419987d8ddcfee675e48) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:04.435480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:04.436954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:04.449449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 46/94] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:04 2022] GET /identity/v3/role_assignments?user.id=4c5eeca39d48419987d8ddcfee675e48&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=32319452053845419798d329f1c194d4 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:04.451666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:04.473604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:04.501372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:04.502001 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:04.502281 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:04.502550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:04.503291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] RBAC: Adding query filter params (role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=331fd9a5519d4bd0a191559b4f25947e, user.id=97526bc1651549bcba3b62f593469545) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:04.503600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:04.505078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:04.524903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 49/95] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:04 2022] GET /identity/v3/role_assignments?user.id=97526bc1651549bcba3b62f593469545&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:04.619493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982582e3-6508-4ca1-adaf-4f9aa079cfb5 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:04.667833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550914e-6f9d-4a03-be57-3d31554f70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:04.668507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550914e-6f9d-4a03-be57-3d31554f70c9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:04.668790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550914e-6f9d-4a03-be57-3d31554f70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:04.669065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550914e-6f9d-4a03-be57-3d31554f70c9 None admin] PATH_INFO: `/v3/projects/d5c03a5578824a4ebd8068461ddffdb4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:04.672763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550914e-6f9d-4a03-be57-3d31554f70c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c03a5578824a4ebd8068461ddffdb4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:04.674845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550914e-6f9d-4a03-be57-3d31554f70c9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:04.677490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 47/96] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:04 2022] GET /identity/v3/projects/d5c03a5578824a4ebd8068461ddffdb4 => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:04.684930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:04.818326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:04.833050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f1aff-1957-41ae-aee6-dfb81a8d7c71 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:04.877802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468b125-274c-4f08-975e-7257bdae1768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:04.878428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b125-274c-4f08-975e-7257bdae1768 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:04.878711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b125-274c-4f08-975e-7257bdae1768 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:04.878984 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b125-274c-4f08-975e-7257bdae1768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:04.879730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468b125-274c-4f08-975e-7257bdae1768 None admin] RBAC: Adding query filter params (role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=d5c03a5578824a4ebd8068461ddffdb4, user.id=97526bc1651549bcba3b62f593469545) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:04.880088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468b125-274c-4f08-975e-7257bdae1768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:04.881552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468b125-274c-4f08-975e-7257bdae1768 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:04.888965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 50/97] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:04 2022] GET /identity/v3/role_assignments?user.id=97526bc1651549bcba3b62f593469545&scope.project.id=d5c03a5578824a4ebd8068461ddffdb4&role.id=4367ece899d646eeb2e2917530897f7f => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:05.221421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28966df-98dd-4709-ad47-8d8f40415fae None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:05.222411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28966df-98dd-4709-ad47-8d8f40415fae None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:05.222924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28966df-98dd-4709-ad47-8d8f40415fae None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:05.224535 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 48/98] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:05.230053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac883-374c-40b6-9ee1-0a359082f5f4 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:05.230344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac883-374c-40b6-9ee1-0a359082f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:05.230627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac883-374c-40b6-9ee1-0a359082f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:05.255223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4ccac883-374c-40b6-9ee1-0a359082f5f4 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:05.256498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4ccac883-374c-40b6-9ee1-0a359082f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:05.339663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 51/99] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:05.489126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987e423-b835-4ed4-8400-c8446b1bc348 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:05.489126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987e423-b835-4ed4-8400-c8446b1bc348 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:05.489126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987e423-b835-4ed4-8400-c8446b1bc348 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:05.489126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 49/100] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:05.494841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45307542-aabe-4243-96cd-50ffa15107e6 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:05.495132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45307542-aabe-4243-96cd-50ffa15107e6 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:05.495415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45307542-aabe-4243-96cd-50ffa15107e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:05.520763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-45307542-aabe-4243-96cd-50ffa15107e6 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:05.522066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-45307542-aabe-4243-96cd-50ffa15107e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:05.603810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 52/101] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:05.782574 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987e423-b835-4ed4-8400-c8446b1bc348 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:05.880970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:05.911154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987e423-b835-4ed4-8400-c8446b1bc348 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:05.917293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45307542-aabe-4243-96cd-50ffa15107e6 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:05.937212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:05.979761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea84982-4297-46d0-8375-ed0650f88033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:05.980441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84982-4297-46d0-8375-ed0650f88033 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:05.980894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84982-4297-46d0-8375-ed0650f88033 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:05.981186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84982-4297-46d0-8375-ed0650f88033 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:05.983145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea84982-4297-46d0-8375-ed0650f88033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:05.989533 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea84982-4297-46d0-8375-ed0650f88033 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:05.991492 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 50/102] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:05.997695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea84982-4297-46d0-8375-ed0650f88033 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:06.110390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45307542-aabe-4243-96cd-50ffa15107e6 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:06.180101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852902ca-3d13-40ed-a9b1-b1c7911e2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:06.180764 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852902ca-3d13-40ed-a9b1-b1c7911e2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:06.181050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852902ca-3d13-40ed-a9b1-b1c7911e2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:06.181327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852902ca-3d13-40ed-a9b1-b1c7911e2bf3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:06.203647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852902ca-3d13-40ed-a9b1-b1c7911e2bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-852902ca-3d13-40ed-a9b1-b1c7911e2bf3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:06.209333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:06.210188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:06.211059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 53/103] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:06.218534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852902ca-3d13-40ed-a9b1-b1c7911e2bf3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:06.222842 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea84982-4297-46d0-8375-ed0650f88033 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:06.304195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d15a3-650d-4278-87ec-5ddcd356d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:06.305774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d15a3-650d-4278-87ec-5ddcd356d0b3 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:06.306260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d15a3-650d-4278-87ec-5ddcd356d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:06.306774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d15a3-650d-4278-87ec-5ddcd356d0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:06.307646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d15a3-650d-4278-87ec-5ddcd356d0b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:06.309352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d15a3-650d-4278-87ec-5ddcd356d0b3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:06.362123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:06.366409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:06.378326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 51/104] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:29:05 2022] POST /identity/v3/projects => generated 302 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:06.414728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852902ca-3d13-40ed-a9b1-b1c7911e2bf3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:06.424242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8777a-6d7f-4abd-957b-034e4107cdd7 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:06.424854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8777a-6d7f-4abd-957b-034e4107cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:06.425328 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8777a-6d7f-4abd-957b-034e4107cdd7 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:06.428657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 52/105] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:06.434088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bec0-65f1-4c96-a0e3-96682f46b895 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:06.434829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bec0-65f1-4c96-a0e3-96682f46b895 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:06.437062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bec0-65f1-4c96-a0e3-96682f46b895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:06.481255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-10c1bec0-65f1-4c96-a0e3-96682f46b895 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:06.487368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-10c1bec0-65f1-4c96-a0e3-96682f46b895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:06.507058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:06.508110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:06.508598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:06.509075 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:06.509993 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:06.510527 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:06.512270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:06.535551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 54/106] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:06.542145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:06.666115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 53/107] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:06.687645 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6687b-8b9c-41da-a17d-2a24cb7517e4 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:06.722246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f7c5-5b57-4001-ae95-54a7b8ce2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:06.722892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f7c5-5b57-4001-ae95-54a7b8ce2555 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:06.723177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f7c5-5b57-4001-ae95-54a7b8ce2555 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:06.723453 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161f7c5-5b57-4001-ae95-54a7b8ce2555 None admin] PATH_INFO: `/v3/users/d163d47c339345cb95258a74b1a042d0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:06.725403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:06.738670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161f7c5-5b57-4001-ae95-54a7b8ce2555 None admin] RBAC: Authorizing `identity:get_user(user_id=d163d47c339345cb95258a74b1a042d0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:06.740197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161f7c5-5b57-4001-ae95-54a7b8ce2555 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:06.742225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 55/108] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:06 2022] GET /identity/v3/users/d163d47c339345cb95258a74b1a042d0 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:06.747549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bec0-65f1-4c96-a0e3-96682f46b895 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:06.855846 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bec0-65f1-4c96-a0e3-96682f46b895 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:06.884638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:06.894325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428155-0c1f-4474-848f-08fa0c0233a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:06.894948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428155-0c1f-4474-848f-08fa0c0233a0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:06.895232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428155-0c1f-4474-848f-08fa0c0233a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:06.895508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428155-0c1f-4474-848f-08fa0c0233a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:06.984731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25428155-0c1f-4474-848f-08fa0c0233a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:06.986284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25428155-0c1f-4474-848f-08fa0c0233a0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:07.031381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f7c5-5b57-4001-ae95-54a7b8ce2555 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:07.174723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 54/109] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:29:07.178017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161f7c5-5b57-4001-ae95-54a7b8ce2555 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:07.180401 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428155-0c1f-4474-848f-08fa0c0233a0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:07.215625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937e56d-4105-4f5c-8dd7-9a9b07da1455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:07.216344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937e56d-4105-4f5c-8dd7-9a9b07da1455 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.216628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937e56d-4105-4f5c-8dd7-9a9b07da1455 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.216904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937e56d-4105-4f5c-8dd7-9a9b07da1455 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.227698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937e56d-4105-4f5c-8dd7-9a9b07da1455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-9937e56d-4105-4f5c-8dd7-9a9b07da1455 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:07.233084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:07.233958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:07.235153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 56/110] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:07.240625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937e56d-4105-4f5c-8dd7-9a9b07da1455 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:07.245797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:07.324198 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:07.363751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937e56d-4105-4f5c-8dd7-9a9b07da1455 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:07.405242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428155-0c1f-4474-848f-08fa0c0233a0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:07.423563 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:07.425464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.425751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.426029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.426708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:07.427014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:07.428462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:07.448296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 57/111] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:07.456454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:07.479287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3cdea-4603-48b3-a586-7a617bfab878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:07.480711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cdea-4603-48b3-a586-7a617bfab878 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.480995 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cdea-4603-48b3-a586-7a617bfab878 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.481269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3cdea-4603-48b3-a586-7a617bfab878 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.482604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3cdea-4603-48b3-a586-7a617bfab878 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:07.485625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3cdea-4603-48b3-a586-7a617bfab878 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:07.488375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 55/112] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:07 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:07.490329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee354-0dbb-4494-a79f-1099a5f8af3e None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.490622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee354-0dbb-4494-a79f-1099a5f8af3e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.490900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee354-0dbb-4494-a79f-1099a5f8af3e None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.496804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 56/113] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:07.496804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaee354-0dbb-4494-a79f-1099a5f8af3e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:07.657202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2655b4-9a13-4b64-87a8-ec3f61720f9c None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:07.685681 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:07.688246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:07.696449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaee354-0dbb-4494-a79f-1099a5f8af3e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:07.712601 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c447b-0235-426a-bda9-407eebf0098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:07.713555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c447b-0235-426a-bda9-407eebf0098b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.714050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c447b-0235-426a-bda9-407eebf0098b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.714479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c447b-0235-426a-bda9-407eebf0098b None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.715842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c447b-0235-426a-bda9-407eebf0098b None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:07.717686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c447b-0235-426a-bda9-407eebf0098b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:07.719882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 58/114] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:07 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:07.725667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52931-7d3c-4278-88af-8a0bb3561ee9 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.726114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52931-7d3c-4278-88af-8a0bb3561ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.727083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52931-7d3c-4278-88af-8a0bb3561ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.736241 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0a04b-c424-4e98-b26c-e618e472fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:07.736884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a04b-c424-4e98-b26c-e618e472fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.737243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a04b-c424-4e98-b26c-e618e472fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.737596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a04b-c424-4e98-b26c-e618e472fbc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.738414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a04b-c424-4e98-b26c-e618e472fbc2 None admin] RBAC: Adding query filter params (role.id=198c78d869d349aebc88462da8545286, scope.project.id=331fd9a5519d4bd0a191559b4f25947e, user.id=d163d47c339345cb95258a74b1a042d0) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:07.738898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a04b-c424-4e98-b26c-e618e472fbc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:07.740472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a04b-c424-4e98-b26c-e618e472fbc2 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:07.746828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 57/115] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:07 2022] GET /identity/v3/role_assignments?user.id=d163d47c339345cb95258a74b1a042d0&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=198c78d869d349aebc88462da8545286 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:07.748813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f588-585f-4b4a-9068-829f8b1ec832 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.749278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f588-585f-4b4a-9068-829f8b1ec832 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.749748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946f588-585f-4b4a-9068-829f8b1ec832 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.751214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 58/116] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:07.752286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f588-585f-4b4a-9068-829f8b1ec832 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:07.753976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-cfa52931-7d3c-4278-88af-8a0bb3561ee9 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:07.755395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-cfa52931-7d3c-4278-88af-8a0bb3561ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:07.864203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 59/117] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:07.866464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52bc9-79b4-45ea-b2aa-9a5cb247d534 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.867059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52bc9-79b4-45ea-b2aa-9a5cb247d534 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.867366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc52bc9-79b4-45ea-b2aa-9a5cb247d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.905680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-2fc52bc9-79b4-45ea-b2aa-9a5cb247d534 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:07.907027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2fc52bc9-79b4-45ea-b2aa-9a5cb247d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:07.934678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946f588-585f-4b4a-9068-829f8b1ec832 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:07.981894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c55f4-8f65-4a79-8292-5235a475608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:07.982545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c55f4-8f65-4a79-8292-5235a475608f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.982831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c55f4-8f65-4a79-8292-5235a475608f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.983114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c55f4-8f65-4a79-8292-5235a475608f None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.984283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c55f4-8f65-4a79-8292-5235a475608f None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:07.985916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c55f4-8f65-4a79-8292-5235a475608f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:07.988110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 59/118] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:07 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:07.990010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3775bd-58b6-4df0-9b02-1698873012ea None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:07.990301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3775bd-58b6-4df0-9b02-1698873012ea None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:07.990582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3775bd-58b6-4df0-9b02-1698873012ea None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:07.992301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 60/119] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:07.993134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3775bd-58b6-4df0-9b02-1698873012ea None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:08.011289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 60/120] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:08.012759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d65c80-6f0c-4c36-9451-4311287f9797 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:08.013108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d65c80-6f0c-4c36-9451-4311287f9797 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:08.013390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d65c80-6f0c-4c36-9451-4311287f9797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:08.038322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:08.057112 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-97d65c80-6f0c-4c36-9451-4311287f9797 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:08.058375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-97d65c80-6f0c-4c36-9451-4311287f9797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:08.157436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3775bd-58b6-4df0-9b02-1698873012ea None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:08.170362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:08.231638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 61/121] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:08.233217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d65c80-6f0c-4c36-9451-4311287f9797 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:08.239019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14e1c-9884-4535-8904-15b8efc2303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:08.239897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14e1c-9884-4535-8904-15b8efc2303f None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:08.240348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14e1c-9884-4535-8904-15b8efc2303f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:08.240767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d14e1c-9884-4535-8904-15b8efc2303f None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e/users/97526bc1651549bcba3b62f593469545/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:08.247504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d14e1c-9884-4535-8904-15b8efc2303f None admin] RBAC: Authorizing `identity:create_grant(project_id=331fd9a5519d4bd0a191559b4f25947e, user_id=97526bc1651549bcba3b62f593469545, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:08.249595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d14e1c-9884-4535-8904-15b8efc2303f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:08.275813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 61/122] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:07 2022] PUT /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e/users/97526bc1651549bcba3b62f593469545/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:08.362252 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d65c80-6f0c-4c36-9451-4311287f9797 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:08.401128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cd258-4f44-476f-9674-30792150b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:08.402046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cd258-4f44-476f-9674-30792150b154 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:08.402477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cd258-4f44-476f-9674-30792150b154 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:08.402897 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cd258-4f44-476f-9674-30792150b154 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:08.414185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cd258-4f44-476f-9674-30792150b154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-1c8cd258-4f44-476f-9674-30792150b154 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:08.419426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:08.420542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:08.421497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:08.423474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 62/123] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:08.429446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14e1c-9884-4535-8904-15b8efc2303f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:08.499357 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cd258-4f44-476f-9674-30792150b154 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:08.535480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:08.539553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:08.556952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d14e1c-9884-4535-8904-15b8efc2303f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:08.626548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:08.627423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:08.627841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:08.628224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:08.629110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:08.629525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:08.631106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:08.633261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cd258-4f44-476f-9674-30792150b154 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:08.640919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 62/124] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:08.641850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:08.677674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80fbbf-63f6-4e35-b757-9f8fafd0a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:08.678612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80fbbf-63f6-4e35-b757-9f8fafd0a357 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:08.678930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80fbbf-63f6-4e35-b757-9f8fafd0a357 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:08.679214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80fbbf-63f6-4e35-b757-9f8fafd0a357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:08.693716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80fbbf-63f6-4e35-b757-9f8fafd0a357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-9a80fbbf-63f6-4e35-b757-9f8fafd0a357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:08.700955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:08.701981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 63/125] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:08.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80fbbf-63f6-4e35-b757-9f8fafd0a357 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:08.801650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa7b63-69b1-4925-af35-e329188e1b16 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:08.811223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:08.821077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80fbbf-63f6-4e35-b757-9f8fafd0a357 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:08.855178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe62ca4-c995-4bad-8570-63a938cf5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:08.856014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62ca4-c995-4bad-8570-63a938cf5646 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:08.856308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62ca4-c995-4bad-8570-63a938cf5646 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:08.856592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62ca4-c995-4bad-8570-63a938cf5646 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:08.876109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248628a-379c-4b05-8dea-ae6aed1ad556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:08.876766 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248628a-379c-4b05-8dea-ae6aed1ad556 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:08.877054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248628a-379c-4b05-8dea-ae6aed1ad556 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:08.877336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248628a-379c-4b05-8dea-ae6aed1ad556 None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:08.880936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248628a-379c-4b05-8dea-ae6aed1ad556 None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:08.883041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248628a-379c-4b05-8dea-ae6aed1ad556 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:08.885692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe62ca4-c995-4bad-8570-63a938cf5646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-cbe62ca4-c995-4bad-8570-63a938cf5646 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:08.891317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:08.893783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 63/126] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:08.895686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe62ca4-c995-4bad-8570-63a938cf5646 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:08.900453 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 64/127] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:08 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:08.900453 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248628a-379c-4b05-8dea-ae6aed1ad556 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:08.924270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:09.014364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe62ca4-c995-4bad-8570-63a938cf5646 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:09.050329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:09.050957 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.051244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.051522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.052301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:09.052555 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:09.053948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:09.063143 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 64/128] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:09.064009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:09.105093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248628a-379c-4b05-8dea-ae6aed1ad556 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:09.160092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:09.181864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98afa71-a10b-4df0-bf5b-1c1b64544f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:09.182513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98afa71-a10b-4df0-bf5b-1c1b64544f8e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.182796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98afa71-a10b-4df0-bf5b-1c1b64544f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.183073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98afa71-a10b-4df0-bf5b-1c1b64544f8e None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.185360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98afa71-a10b-4df0-bf5b-1c1b64544f8e None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:09.186944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98afa71-a10b-4df0-bf5b-1c1b64544f8e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:09.188627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 65/129] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:08 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:09.190250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98afa71-a10b-4df0-bf5b-1c1b64544f8e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:09.217914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb741-e6d4-427f-857a-ba218d27ff5b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:09.260206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:09.312125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:09.312773 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.312956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.313213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.313889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:09.314252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:09.317220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:09.333402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98afa71-a10b-4df0-bf5b-1c1b64544f8e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:09.334864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 65/130] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:09.335502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:09.373173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22360bf-84d7-42bf-86ba-70764849b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:09.373813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22360bf-84d7-42bf-86ba-70764849b130 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.374101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22360bf-84d7-42bf-86ba-70764849b130 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.374376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22360bf-84d7-42bf-86ba-70764849b130 None admin] PATH_INFO: `/v3/users/4c5eeca39d48419987d8ddcfee675e48` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.375499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22360bf-84d7-42bf-86ba-70764849b130 None admin] RBAC: Authorizing `identity:get_user(user_id=4c5eeca39d48419987d8ddcfee675e48)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:09.377012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22360bf-84d7-42bf-86ba-70764849b130 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:09.378643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 66/131] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:09 2022] GET /identity/v3/users/4c5eeca39d48419987d8ddcfee675e48 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:09.384167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18ccf-b064-49bc-907c-24a6b89b996f None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.384460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18ccf-b064-49bc-907c-24a6b89b996f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.384746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18ccf-b064-49bc-907c-24a6b89b996f None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.386025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 67/132] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:09.390146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d18ccf-b064-49bc-907c-24a6b89b996f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:09.462857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3bf2b-fffe-430d-8c65-ba3c27f0a2aa None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:09.489535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:09.498924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d18ccf-b064-49bc-907c-24a6b89b996f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:09.511015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f15eb-051e-4c25-856b-5096b7ecb9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:09.511804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f15eb-051e-4c25-856b-5096b7ecb9bb None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.512438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f15eb-051e-4c25-856b-5096b7ecb9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.512796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f15eb-051e-4c25-856b-5096b7ecb9bb None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e/users/97526bc1651549bcba3b62f593469545/roles/a37614139c1f4c259c28b64ce0a959a2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.515818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f15eb-051e-4c25-856b-5096b7ecb9bb None admin] RBAC: Authorizing `identity:create_grant(project_id=331fd9a5519d4bd0a191559b4f25947e, user_id=97526bc1651549bcba3b62f593469545, role_id=a37614139c1f4c259c28b64ce0a959a2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:09.517914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f15eb-051e-4c25-856b-5096b7ecb9bb None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:09.520613 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:09.544393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 66/133] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:09 2022] PUT /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e/users/97526bc1651549bcba3b62f593469545/roles/a37614139c1f4c259c28b64ce0a959a2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:09.545442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f15eb-051e-4c25-856b-5096b7ecb9bb None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:09.547372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80fd1-2211-449e-b7f9-31c50b5c5372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:09.548691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80fd1-2211-449e-b7f9-31c50b5c5372 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.549233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80fd1-2211-449e-b7f9-31c50b5c5372 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.549704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80fd1-2211-449e-b7f9-31c50b5c5372 None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.551239 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e80fd1-2211-449e-b7f9-31c50b5c5372 None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:09.553016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e80fd1-2211-449e-b7f9-31c50b5c5372 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:09.555676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 68/134] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:09 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:09.557395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60023-5c0d-4304-b207-972af59f1c80 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.557887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60023-5c0d-4304-b207-972af59f1c80 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.558377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60023-5c0d-4304-b207-972af59f1c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.581195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-5fb60023-5c0d-4304-b207-972af59f1c80 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:09.583095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5fb60023-5c0d-4304-b207-972af59f1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:09.689464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f15eb-051e-4c25-856b-5096b7ecb9bb None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:09.717658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 69/135] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:09.721851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60023-5c0d-4304-b207-972af59f1c80 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:09.734561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612c756-89cc-42d6-8d7e-17d7d66effd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:09.735209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c756-89cc-42d6-8d7e-17d7d66effd1 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.735496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c756-89cc-42d6-8d7e-17d7d66effd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.735797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c756-89cc-42d6-8d7e-17d7d66effd1 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.736952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612c756-89cc-42d6-8d7e-17d7d66effd1 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:09.738902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612c756-89cc-42d6-8d7e-17d7d66effd1 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:09.742711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 67/136] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:09 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:09.748380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612c756-89cc-42d6-8d7e-17d7d66effd1 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:09.825086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:09.874283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612c756-89cc-42d6-8d7e-17d7d66effd1 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:09.915531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829c35-887c-478e-a709-d8117084cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:09.916619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829c35-887c-478e-a709-d8117084cbac None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:09.916910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829c35-887c-478e-a709-d8117084cbac None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:09.917190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829c35-887c-478e-a709-d8117084cbac None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e/users/4c5eeca39d48419987d8ddcfee675e48/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:09.919701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26829c35-887c-478e-a709-d8117084cbac None admin] RBAC: Authorizing `identity:create_grant(project_id=331fd9a5519d4bd0a191559b4f25947e, user_id=4c5eeca39d48419987d8ddcfee675e48, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:09.921363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26829c35-887c-478e-a709-d8117084cbac None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:09.933517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:09.939174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 68/137] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:09 2022] PUT /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e/users/4c5eeca39d48419987d8ddcfee675e48/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:09.953872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60023-5c0d-4304-b207-972af59f1c80 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:10.016498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeb818-08a2-4328-b9e9-7b66ca32e9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:10.017201 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb818-08a2-4328-b9e9-7b66ca32e9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:10.017506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb818-08a2-4328-b9e9-7b66ca32e9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:10.017785 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb818-08a2-4328-b9e9-7b66ca32e9e9 None admin] PATH_INFO: `/v3/projects/d5c03a5578824a4ebd8068461ddffdb4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:10.018965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdeb818-08a2-4328-b9e9-7b66ca32e9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c03a5578824a4ebd8068461ddffdb4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:10.020457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdeb818-08a2-4328-b9e9-7b66ca32e9e9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:10.022110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 70/138] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:09 2022] GET /identity/v3/projects/d5c03a5578824a4ebd8068461ddffdb4 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:10.028636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829c35-887c-478e-a709-d8117084cbac None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:10.089589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeb818-08a2-4328-b9e9-7b66ca32e9e9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:10.194387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829c35-887c-478e-a709-d8117084cbac None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:10.226216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:10.230159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeb818-08a2-4328-b9e9-7b66ca32e9e9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:10.241729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae59deb-00fd-43a9-89d0-b3cfca7eee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:10.243919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae59deb-00fd-43a9-89d0-b3cfca7eee0f None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:10.244319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae59deb-00fd-43a9-89d0-b3cfca7eee0f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:10.244750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae59deb-00fd-43a9-89d0-b3cfca7eee0f None admin] PATH_INFO: `/v3/projects/d5c03a5578824a4ebd8068461ddffdb4/users/97526bc1651549bcba3b62f593469545/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:10.247547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae59deb-00fd-43a9-89d0-b3cfca7eee0f None admin] RBAC: Authorizing `identity:create_grant(project_id=d5c03a5578824a4ebd8068461ddffdb4, user_id=97526bc1651549bcba3b62f593469545, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:10.250037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae59deb-00fd-43a9-89d0-b3cfca7eee0f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:10.268489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 69/139] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:10 2022] PUT /identity/v3/projects/d5c03a5578824a4ebd8068461ddffdb4/users/97526bc1651549bcba3b62f593469545/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:10.276549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dc73e-ffc0-4979-a5f6-a7de270e35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:10.277529 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dc73e-ffc0-4979-a5f6-a7de270e35e9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:10.277945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dc73e-ffc0-4979-a5f6-a7de270e35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:10.278655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dc73e-ffc0-4979-a5f6-a7de270e35e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:10.280369 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dc73e-ffc0-4979-a5f6-a7de270e35e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:10.282098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dc73e-ffc0-4979-a5f6-a7de270e35e9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:10.284190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 71/140] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:10.290497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae59deb-00fd-43a9-89d0-b3cfca7eee0f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:10.416041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae59deb-00fd-43a9-89d0-b3cfca7eee0f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:10.452840 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6611f-0fe4-43c1-b680-ae22ba229f86 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:10.453393 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6611f-0fe4-43c1-b680-ae22ba229f86 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:10.453846 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6611f-0fe4-43c1-b680-ae22ba229f86 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:10.455350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 72/141] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:10.465030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df332-c66c-4cab-9cf7-37645ca71bdc None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:10.465542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df332-c66c-4cab-9cf7-37645ca71bdc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:10.466004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df332-c66c-4cab-9cf7-37645ca71bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:10.484222 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26d8a-e66c-4ddc-9560-24911eae3e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:10.485129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26d8a-e66c-4ddc-9560-24911eae3e77 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:10.485583 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26d8a-e66c-4ddc-9560-24911eae3e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:10.486028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b26d8a-e66c-4ddc-9560-24911eae3e77 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:10.486900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26d8a-e66c-4ddc-9560-24911eae3e77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:10.491520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b26d8a-e66c-4ddc-9560-24911eae3e77 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:10.495032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b33df332-c66c-4cab-9cf7-37645ca71bdc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:10.497294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b33df332-c66c-4cab-9cf7-37645ca71bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:10.544893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 70/142] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:10 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:10.552745 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:10.606442 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 73/143] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:11.024343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26d8a-e66c-4ddc-9560-24911eae3e77 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:11.074261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:11.151174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b26d8a-e66c-4ddc-9560-24911eae3e77 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:11.174462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c3ead-a4d4-41d2-b0c7-46e3fa351c05 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:11.174777 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c3ead-a4d4-41d2-b0c7-46e3fa351c05 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:11.175013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c3ead-a4d4-41d2-b0c7-46e3fa351c05 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:11.176615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 74/144] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:11.182184 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccb793-e48c-49d5-8863-2786fdbdf736 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:11.182510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccb793-e48c-49d5-8863-2786fdbdf736 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:11.182732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccb793-e48c-49d5-8863-2786fdbdf736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:11.208492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-caccb793-e48c-49d5-8863-2786fdbdf736 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:11.209583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-caccb793-e48c-49d5-8863-2786fdbdf736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:11.230931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4ece1-f6a0-4a64-b9a0-fd9fff00acbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:11.231632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4ece1-f6a0-4a64-b9a0-fd9fff00acbe None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:11.231949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4ece1-f6a0-4a64-b9a0-fd9fff00acbe None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:11.232222 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4ece1-f6a0-4a64-b9a0-fd9fff00acbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:11.249228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4ece1-f6a0-4a64-b9a0-fd9fff00acbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7cb4ece1-f6a0-4a64-b9a0-fd9fff00acbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:11.254090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:11.255009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:11.255815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 71/145] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:11.270824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4ece1-f6a0-4a64-b9a0-fd9fff00acbe None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:11.359565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 75/146] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:11.427523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:11.432499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4ece1-f6a0-4a64-b9a0-fd9fff00acbe None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:11.477376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:11.477931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:11.478212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:11.478489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:11.479177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:11.479481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:11.480960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:11.492013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 72/147] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:11.497819 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccb793-e48c-49d5-8863-2786fdbdf736 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:11.595671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:11.607126 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccb793-e48c-49d5-8863-2786fdbdf736 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:11.643664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0711168-5045-407f-a5e3-32a555364dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:11.644344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0711168-5045-407f-a5e3-32a555364dfe None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:11.644621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0711168-5045-407f-a5e3-32a555364dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:11.644891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0711168-5045-407f-a5e3-32a555364dfe None admin] PATH_INFO: `/v3/users/d163d47c339345cb95258a74b1a042d0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:11.646019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0711168-5045-407f-a5e3-32a555364dfe None admin] RBAC: Authorizing `identity:get_user(user_id=d163d47c339345cb95258a74b1a042d0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:11.647551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0711168-5045-407f-a5e3-32a555364dfe None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:11.649466 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 76/148] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:11 2022] GET /identity/v3/users/d163d47c339345cb95258a74b1a042d0 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:11.655255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:11.770073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f7369-9b7b-40ee-88b0-ee85e785824c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:11.776391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0711168-5045-407f-a5e3-32a555364dfe None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:11.850372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e670c-b935-4923-89cb-7ef6e2f58e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:11.851083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e670c-b935-4923-89cb-7ef6e2f58e28 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:11.851414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e670c-b935-4923-89cb-7ef6e2f58e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:11.851685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e670c-b935-4923-89cb-7ef6e2f58e28 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:11.854416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e670c-b935-4923-89cb-7ef6e2f58e28 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:11.855792 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e670c-b935-4923-89cb-7ef6e2f58e28 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:11.859868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 73/149] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:11 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:11.869005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e670c-b935-4923-89cb-7ef6e2f58e28 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:11.909785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:11.972237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0711168-5045-407f-a5e3-32a555364dfe None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:11.995054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e670c-b935-4923-89cb-7ef6e2f58e28 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:12.036752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87193046-ef95-48e9-8555-dfcf35f4d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:12.037754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87193046-ef95-48e9-8555-dfcf35f4d19c None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:12.038246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87193046-ef95-48e9-8555-dfcf35f4d19c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:12.039254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87193046-ef95-48e9-8555-dfcf35f4d19c None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e/users/d163d47c339345cb95258a74b1a042d0/roles/198c78d869d349aebc88462da8545286` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:12.041522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87193046-ef95-48e9-8555-dfcf35f4d19c None admin] RBAC: Authorizing `identity:create_grant(project_id=331fd9a5519d4bd0a191559b4f25947e, user_id=d163d47c339345cb95258a74b1a042d0, role_id=198c78d869d349aebc88462da8545286)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:12.043175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87193046-ef95-48e9-8555-dfcf35f4d19c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:12.048566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa172314-7c98-46e6-b89e-7e93a41e2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:12.049276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa172314-7c98-46e6-b89e-7e93a41e2f66 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:12.050310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa172314-7c98-46e6-b89e-7e93a41e2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:12.050310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa172314-7c98-46e6-b89e-7e93a41e2f66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:12.063500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 74/150] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:11 2022] PUT /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e/users/d163d47c339345cb95258a74b1a042d0/roles/198c78d869d349aebc88462da8545286 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:29:12.073034 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa172314-7c98-46e6-b89e-7e93a41e2f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-aa172314-7c98-46e6-b89e-7e93a41e2f66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:12.078588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:12.079479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:12.080298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 77/151] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:12.085907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87193046-ef95-48e9-8555-dfcf35f4d19c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:12.200718 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:12.211742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87193046-ef95-48e9-8555-dfcf35f4d19c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:12.252812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:12.253447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:12.253726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:12.254000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:12.254685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:12.255047 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:12.256775 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:12.266089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 75/152] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:12.271748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa172314-7c98-46e6-b89e-7e93a41e2f66 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:12.299751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:12.395257 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa172314-7c98-46e6-b89e-7e93a41e2f66 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:12.442878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0162d14-9452-40ff-b972-c213d9fdc3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:12.443883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162d14-9452-40ff-b972-c213d9fdc3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:12.444355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162d14-9452-40ff-b972-c213d9fdc3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:12.444814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162d14-9452-40ff-b972-c213d9fdc3a9 None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:12.446269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0162d14-9452-40ff-b972-c213d9fdc3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:12.447980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0162d14-9452-40ff-b972-c213d9fdc3a9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:12.449777 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 78/153] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:12 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:12.455716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:12.593155 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4380-cd9f-4645-9432-ee54a652c8a3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:12.636148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf280be-8421-4a72-a6be-f64f933a3b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:12.636773 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf280be-8421-4a72-a6be-f64f933a3b2b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:12.637059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf280be-8421-4a72-a6be-f64f933a3b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:12.637338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf280be-8421-4a72-a6be-f64f933a3b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:12.666674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:12.722743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf280be-8421-4a72-a6be-f64f933a3b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:12.724271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf280be-8421-4a72-a6be-f64f933a3b2b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:12.791430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6425b5-a7dd-4f30-8182-2665ceccfccb None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:12.792385 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6425b5-a7dd-4f30-8182-2665ceccfccb None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:12.792868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6425b5-a7dd-4f30-8182-2665ceccfccb None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:12.794501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 79/154] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:12.803761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da471b2-428b-4337-9f2e-c552329cc710 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:12.804412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da471b2-428b-4337-9f2e-c552329cc710 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:12.804888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da471b2-428b-4337-9f2e-c552329cc710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:12.834679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-5da471b2-428b-4337-9f2e-c552329cc710 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:12.836755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5da471b2-428b-4337-9f2e-c552329cc710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:12.872960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 76/155] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:12.878873 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf280be-8421-4a72-a6be-f64f933a3b2b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:12.941992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 80/156] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:12.974748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:13.044562 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf280be-8421-4a72-a6be-f64f933a3b2b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:13.090016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf582ee-0af7-4282-9a2d-06549348349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:13.090665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf582ee-0af7-4282-9a2d-06549348349c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:13.090949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf582ee-0af7-4282-9a2d-06549348349c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:13.091226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf582ee-0af7-4282-9a2d-06549348349c None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:13.092385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf582ee-0af7-4282-9a2d-06549348349c None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:13.093843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf582ee-0af7-4282-9a2d-06549348349c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:13.095492 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 77/157] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:12 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:13.101445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da471b2-428b-4337-9f2e-c552329cc710 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:13.128145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:13.238814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da471b2-428b-4337-9f2e-c552329cc710 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:13.273332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a2a26-07cc-4986-b3e2-b4fdfd9efd8c None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:13.273963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a2a26-07cc-4986-b3e2-b4fdfd9efd8c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:13.274471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a2a26-07cc-4986-b3e2-b4fdfd9efd8c None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:13.280653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 78/158] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:13.285464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7667d-8019-4834-8e25-31c1affb9736 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:13.285987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7667d-8019-4834-8e25-31c1affb9736 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:13.286553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7667d-8019-4834-8e25-31c1affb9736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:13.291371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:13.292028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:13.292311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:13.292586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:13.293328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] RBAC: Adding query filter params (role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=331fd9a5519d4bd0a191559b4f25947e, user.id=97526bc1651549bcba3b62f593469545) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:13.293637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:13.299796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:13.308984 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 81/159] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:13 2022] GET /identity/v3/role_assignments?user.id=97526bc1651549bcba3b62f593469545&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=4367ece899d646eeb2e2917530897f7f => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:13.315436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-41b7667d-8019-4834-8e25-31c1affb9736 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:13.317025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-41b7667d-8019-4834-8e25-31c1affb9736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:13.431931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 79/160] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:13.498494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:13.610268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:13.630994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a4a8-e54d-4eda-9e23-8e62daa11ee9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:13.678452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cdf1f-1a93-4294-8101-24ab5a493841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:13.679100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cdf1f-1a93-4294-8101-24ab5a493841 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:13.680014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cdf1f-1a93-4294-8101-24ab5a493841 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:13.680296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cdf1f-1a93-4294-8101-24ab5a493841 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:13.696718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cdf1f-1a93-4294-8101-24ab5a493841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-e93cdf1f-1a93-4294-8101-24ab5a493841 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:13.702014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:13.702918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:13.703710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 82/161] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:13.710911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7667d-8019-4834-8e25-31c1affb9736 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:13.812139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:13.853284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046826-726f-46c2-9017-66d281120938 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:13.853844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046826-726f-46c2-9017-66d281120938 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:13.853844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff046826-726f-46c2-9017-66d281120938 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:13.855458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 83/162] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:13.864082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7667d-8019-4834-8e25-31c1affb9736 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:13.867828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391525-e230-47e6-aea8-1c6dc2402008 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:13.868122 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391525-e230-47e6-aea8-1c6dc2402008 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:13.868404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1391525-e230-47e6-aea8-1c6dc2402008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:13.912505 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:13.913142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:13.913427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:13.913781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:13.914948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:13.915254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:13.916683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:13.924794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-e1391525-e230-47e6-aea8-1c6dc2402008 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:13.925557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 80/163] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:13.926005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e1391525-e230-47e6-aea8-1c6dc2402008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:13.931175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:14.055294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 84/164] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:14.089825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a72a1c-dd43-4a08-935f-25447d1da11b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:14.101103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1391525-e230-47e6-aea8-1c6dc2402008 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:14.108169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:14.139090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab1f46-1fd3-44b1-bd7d-597c8f64f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:14.139740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1f46-1fd3-44b1-bd7d-597c8f64f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:14.140055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1f46-1fd3-44b1-bd7d-597c8f64f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:14.140327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1f46-1fd3-44b1-bd7d-597c8f64f3d9 None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:14.144448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab1f46-1fd3-44b1-bd7d-597c8f64f3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:14.145916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab1f46-1fd3-44b1-bd7d-597c8f64f3d9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:14.147742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 81/165] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:13 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:14.156768 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab1f46-1fd3-44b1-bd7d-597c8f64f3d9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:14.265687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:14.301100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab1f46-1fd3-44b1-bd7d-597c8f64f3d9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:14.332251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1391525-e230-47e6-aea8-1c6dc2402008 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:14.348711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8bb1a-c387-47ee-ba4b-29490e662f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:14.349586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8bb1a-c387-47ee-ba4b-29490e662f42 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:14.349864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8bb1a-c387-47ee-ba4b-29490e662f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:14.350143 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8bb1a-c387-47ee-ba4b-29490e662f42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:14.392575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2090-9d8e-4c71-b6d2-74e7077c8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:14.393213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2090-9d8e-4c71-b6d2-74e7077c8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:14.393487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2090-9d8e-4c71-b6d2-74e7077c8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:14.393759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2090-9d8e-4c71-b6d2-74e7077c8fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:14.420762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a2090-9d8e-4c71-b6d2-74e7077c8fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b04a2090-9d8e-4c71-b6d2-74e7077c8fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:14.428060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:14.428934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:14.430478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 85/166] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:14.438762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2090-9d8e-4c71-b6d2-74e7077c8fa7 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:14.453994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:14.505573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8bb1a-c387-47ee-ba4b-29490e662f42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:14.507059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8bb1a-c387-47ee-ba4b-29490e662f42 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:14.677318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2090-9d8e-4c71-b6d2-74e7077c8fa7 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:14.737034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 82/167] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:29:14.737890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8bb1a-c387-47ee-ba4b-29490e662f42 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:14.739799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:14.748256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:14.748879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:14.749165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:14.749441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:14.750120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:14.750834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:14.752262 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:14.778210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 86/168] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:14.784637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:14.897705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:14.938563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8bb1a-c387-47ee-ba4b-29490e662f42 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:14.968184 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ce765-17bb-487b-9723-d0512f0eee49 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:15.001183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816fc99-0377-41fe-988d-341f6e26e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:15.003170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816fc99-0377-41fe-988d-341f6e26e69f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.004587 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816fc99-0377-41fe-988d-341f6e26e69f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.005006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816fc99-0377-41fe-988d-341f6e26e69f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.024345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816fc99-0377-41fe-988d-341f6e26e69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-e816fc99-0377-41fe-988d-341f6e26e69f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:15.030212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:15.031268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:15.032262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:15.039652 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93409e-c4da-4e01-80d7-a5f7b9f21f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:15.040773 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93409e-c4da-4e01-80d7-a5f7b9f21f72 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.041482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 83/169] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:15.042402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816fc99-0377-41fe-988d-341f6e26e69f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:15.042822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93409e-c4da-4e01-80d7-a5f7b9f21f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.043309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93409e-c4da-4e01-80d7-a5f7b9f21f72 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.045344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93409e-c4da-4e01-80d7-a5f7b9f21f72 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:15.049269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93409e-c4da-4e01-80d7-a5f7b9f21f72 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:15.051087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 87/170] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:14 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:15.053206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387af056-32aa-48bb-af32-deab5b06d97f None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.053706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387af056-32aa-48bb-af32-deab5b06d97f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.063646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387af056-32aa-48bb-af32-deab5b06d97f None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.065345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 88/171] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:15.066234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387af056-32aa-48bb-af32-deab5b06d97f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:15.148432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:15.208943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387af056-32aa-48bb-af32-deab5b06d97f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:15.222371 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816fc99-0377-41fe-988d-341f6e26e69f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:15.244495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:15.245110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.245390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.245666 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.246337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:15.246643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:15.248079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:15.256849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 89/172] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:15.257736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:15.260357 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9299cf-0e48-4ca6-8ea0-09c7a6645a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:15.261093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9299cf-0e48-4ca6-8ea0-09c7a6645a0f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.261382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9299cf-0e48-4ca6-8ea0-09c7a6645a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.261658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9299cf-0e48-4ca6-8ea0-09c7a6645a0f None admin] PATH_INFO: `/v3/users/4c5eeca39d48419987d8ddcfee675e48` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.262806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9299cf-0e48-4ca6-8ea0-09c7a6645a0f None admin] RBAC: Authorizing `identity:get_user(user_id=4c5eeca39d48419987d8ddcfee675e48)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:15.264312 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9299cf-0e48-4ca6-8ea0-09c7a6645a0f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:15.265969 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 84/173] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:15 2022] GET /identity/v3/users/4c5eeca39d48419987d8ddcfee675e48 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:15.267199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a62f-5a1e-42e0-af91-fdad677c9171 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.267486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a62f-5a1e-42e0-af91-fdad677c9171 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.267765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a62f-5a1e-42e0-af91-fdad677c9171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.281365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:15.287560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-0b79a62f-5a1e-42e0-af91-fdad677c9171 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:15.289570 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0b79a62f-5a1e-42e0-af91-fdad677c9171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:15.365041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 85/174] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:15.366331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5381e-69e7-4b34-b20c-deab52ba4b4a None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.366605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5381e-69e7-4b34-b20c-deab52ba4b4a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.366916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5381e-69e7-4b34-b20c-deab52ba4b4a None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.368345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 86/175] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:15.369042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5381e-69e7-4b34-b20c-deab52ba4b4a None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:15.374019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c177-cb0b-4cdc-9581-50de7ee67d9f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:15.414335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:15.440483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:15.441115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.441372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.441656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.442412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] RBAC: Adding query filter params (role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=331fd9a5519d4bd0a191559b4f25947e, user.id=97526bc1651549bcba3b62f593469545) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:15.442726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:15.444241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:15.460293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 90/176] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:15 2022] GET /identity/v3/role_assignments?user.id=97526bc1651549bcba3b62f593469545&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:15.461668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:15.496685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5381e-69e7-4b34-b20c-deab52ba4b4a None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:15.572131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c4657-3a6a-437d-9289-e44427437619 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:15.584537 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5d05c-0fcd-4ab6-885c-29209f9030cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:15.586101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5d05c-0fcd-4ab6-885c-29209f9030cc None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.586580 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5d05c-0fcd-4ab6-885c-29209f9030cc None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.587097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5d05c-0fcd-4ab6-885c-29209f9030cc None admin] PATH_INFO: `/v3/users/97526bc1651549bcba3b62f593469545` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.591716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5d05c-0fcd-4ab6-885c-29209f9030cc None admin] RBAC: Authorizing `identity:get_user(user_id=97526bc1651549bcba3b62f593469545)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:15.593518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5d05c-0fcd-4ab6-885c-29209f9030cc None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:15.595441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 87/177] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:15 2022] GET /identity/v3/users/97526bc1651549bcba3b62f593469545 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:15.600034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300740b-8712-48af-b0d1-7f2937845a17 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.600710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300740b-8712-48af-b0d1-7f2937845a17 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.601733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300740b-8712-48af-b0d1-7f2937845a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.611293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b9004-e859-4670-89e1-6abe6a1cc36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:15.612026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b9004-e859-4670-89e1-6abe6a1cc36a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.612336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b9004-e859-4670-89e1-6abe6a1cc36a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.612679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b9004-e859-4670-89e1-6abe6a1cc36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.635259 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:15.645974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-1300740b-8712-48af-b0d1-7f2937845a17 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:15.647585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1300740b-8712-48af-b0d1-7f2937845a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:15.685963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:15.708801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b9004-e859-4670-89e1-6abe6a1cc36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:15.711556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b9004-e859-4670-89e1-6abe6a1cc36a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:15.741932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 88/178] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:15.743018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fbb4d-0476-4577-b2fb-99cca9ecef25 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.743301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fbb4d-0476-4577-b2fb-99cca9ecef25 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.743574 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fbb4d-0476-4577-b2fb-99cca9ecef25 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.750200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 89/179] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:15.754280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fbb4d-0476-4577-b2fb-99cca9ecef25 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:15.869640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 91/180] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:15.869822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05726f58-aba1-4125-bdf6-26ca93c7e7d6 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.870049 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05726f58-aba1-4125-bdf6-26ca93c7e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.870260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05726f58-aba1-4125-bdf6-26ca93c7e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.892576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-05726f58-aba1-4125-bdf6-26ca93c7e7d6 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:15.892756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fbb4d-0476-4577-b2fb-99cca9ecef25 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:15.893789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-05726f58-aba1-4125-bdf6-26ca93c7e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:15.931387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed766d6e-31b1-4d6e-a70b-5d2f46c50629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:15.932033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766d6e-31b1-4d6e-a70b-5d2f46c50629 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:15.932316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766d6e-31b1-4d6e-a70b-5d2f46c50629 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:15.932591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed766d6e-31b1-4d6e-a70b-5d2f46c50629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:15.935361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:15.967026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 92/181] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:15.968078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05726f58-aba1-4125-bdf6-26ca93c7e7d6 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:15.991856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.025531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed766d6e-31b1-4d6e-a70b-5d2f46c50629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:16.027685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed766d6e-31b1-4d6e-a70b-5d2f46c50629 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:16.079356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05726f58-aba1-4125-bdf6-26ca93c7e7d6 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.114510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dab20-e649-4938-99b6-b2cf65102777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.115136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dab20-e649-4938-99b6-b2cf65102777 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.115417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dab20-e649-4938-99b6-b2cf65102777 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.115697 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dab20-e649-4938-99b6-b2cf65102777 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.126533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dab20-e649-4938-99b6-b2cf65102777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f39dab20-e649-4938-99b6-b2cf65102777 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:16.131500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:16.132396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:16.133744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 93/182] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:16.134380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4120af-4211-4f82-9004-b991f296a8a2 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.134936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4120af-4211-4f82-9004-b991f296a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.134936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4120af-4211-4f82-9004-b991f296a8a2 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.136298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 94/183] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:16.140893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4120af-4211-4f82-9004-b991f296a8a2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.143833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 90/184] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:16.143833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed766d6e-31b1-4d6e-a70b-5d2f46c50629 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.181571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.227057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.252661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed766d6e-31b1-4d6e-a70b-5d2f46c50629 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.254131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4120af-4211-4f82-9004-b991f296a8a2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.287224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce69193-a1ef-485d-b25b-0eb47828d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.287885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69193-a1ef-485d-b25b-0eb47828d533 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.288161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69193-a1ef-485d-b25b-0eb47828d533 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.288427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69193-a1ef-485d-b25b-0eb47828d533 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.289141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a594a1-4f35-4e75-a29f-ab2dd7156ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.289812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a594a1-4f35-4e75-a29f-ab2dd7156ecc None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.290102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a594a1-4f35-4e75-a29f-ab2dd7156ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.290376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a594a1-4f35-4e75-a29f-ab2dd7156ecc None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.291519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a594a1-4f35-4e75-a29f-ab2dd7156ecc None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:16.293028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a594a1-4f35-4e75-a29f-ab2dd7156ecc None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:16.294652 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 95/185] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:16.295410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a594a1-4f35-4e75-a29f-ab2dd7156ecc None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.298293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce69193-a1ef-485d-b25b-0eb47828d533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-cce69193-a1ef-485d-b25b-0eb47828d533 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:16.303395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:16.304925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 91/186] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:16.310404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390644e-1906-4f83-9fb1-d07b7db9439e None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.311110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390644e-1906-4f83-9fb1-d07b7db9439e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.311110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390644e-1906-4f83-9fb1-d07b7db9439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.324397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-4390644e-1906-4f83-9fb1-d07b7db9439e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:16.325557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4390644e-1906-4f83-9fb1-d07b7db9439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:16.391543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 92/187] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:16.392224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390644e-1906-4f83-9fb1-d07b7db9439e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.396782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a594a1-4f35-4e75-a29f-ab2dd7156ecc None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.417805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.439518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.441116 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.441599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.442290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.443381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:16.443888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:16.446498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:16.455380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 96/188] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:16.456384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.467318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.505638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390644e-1906-4f83-9fb1-d07b7db9439e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.542397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b980a2-be8c-41b8-a0c9-d3ed65ea3990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.543147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b980a2-be8c-41b8-a0c9-d3ed65ea3990 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.543419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b980a2-be8c-41b8-a0c9-d3ed65ea3990 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.543697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b980a2-be8c-41b8-a0c9-d3ed65ea3990 None admin] PATH_INFO: `/v3/projects/d5c03a5578824a4ebd8068461ddffdb4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.544872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b980a2-be8c-41b8-a0c9-d3ed65ea3990 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c03a5578824a4ebd8068461ddffdb4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:16.546568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b980a2-be8c-41b8-a0c9-d3ed65ea3990 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:16.553841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 93/189] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/projects/d5c03a5578824a4ebd8068461ddffdb4 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:16.553841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b980a2-be8c-41b8-a0c9-d3ed65ea3990 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.572534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259aa3a-d240-4e9e-92f4-e30242c2f038 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.608520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd14b31-c79f-47bf-b252-73e18c2c46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.609383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14b31-c79f-47bf-b252-73e18c2c46c0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.609874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14b31-c79f-47bf-b252-73e18c2c46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.610151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14b31-c79f-47bf-b252-73e18c2c46c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.620998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd14b31-c79f-47bf-b252-73e18c2c46c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-afd14b31-c79f-47bf-b252-73e18c2c46c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:16.626175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:16.627055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:16.627860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 97/190] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:16.628521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd14b31-c79f-47bf-b252-73e18c2c46c0 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.652435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.663007 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b980a2-be8c-41b8-a0c9-d3ed65ea3990 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.696739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.698122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.698834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.699114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.699384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.700217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=331fd9a5519d4bd0a191559b4f25947e, user.id=4c5eeca39d48419987d8ddcfee675e48) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:16.700520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:16.701956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:16.707714 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 94/191] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/role_assignments?user.id=4c5eeca39d48419987d8ddcfee675e48&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=32319452053845419798d329f1c194d4 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:16.708509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.739244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd14b31-c79f-47bf-b252-73e18c2c46c0 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.779084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.779610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.779917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.780188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.780871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:16.781172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:16.782600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:16.792750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 98/192] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:16.798357 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.829422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c6ae3-4679-4572-a660-641be5e95b65 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.872398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bced13-81cd-40a7-a566-09c94bf3a951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.873048 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bced13-81cd-40a7-a566-09c94bf3a951 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.873335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bced13-81cd-40a7-a566-09c94bf3a951 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.873611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bced13-81cd-40a7-a566-09c94bf3a951 None admin] PATH_INFO: `/v3/users/098ef422c6dd458f88be59f2860ae370` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.894723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bced13-81cd-40a7-a566-09c94bf3a951 None admin] RBAC: Authorizing `identity:get_user(user_id=098ef422c6dd458f88be59f2860ae370)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:16.896314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bced13-81cd-40a7-a566-09c94bf3a951 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:16.898765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 95/193] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/users/098ef422c6dd458f88be59f2860ae370 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:16.899542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bced13-81cd-40a7-a566-09c94bf3a951 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:16.921781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.925304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d833-5bee-4607-bad9-c17d85333dd0 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:16.953456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:16.963008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:16.963616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:16.963930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:16.964201 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:16.964932 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] RBAC: Adding query filter params (role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=d5c03a5578824a4ebd8068461ddffdb4, user.id=97526bc1651549bcba3b62f593469545) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:16.965241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:16.966686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:16.972322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 99/194] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/role_assignments?user.id=97526bc1651549bcba3b62f593469545&scope.project.id=d5c03a5578824a4ebd8068461ddffdb4&role.id=4367ece899d646eeb2e2917530897f7f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:16.984032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.026037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bced13-81cd-40a7-a566-09c94bf3a951 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:17.064725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:17.065274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:17.065551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:17.065826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:17.066507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:17.066809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:17.068373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:17.078293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 96/195] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:17.079039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.095926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28a20-e782-4c63-b8d1-2b2457b89fe9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:17.136582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ce41-9eef-410d-a724-40e47e82ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:17.137233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ce41-9eef-410d-a724-40e47e82ccec None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:17.137508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ce41-9eef-410d-a724-40e47e82ccec None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:17.137776 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ce41-9eef-410d-a724-40e47e82ccec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:17.138895 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ce41-9eef-410d-a724-40e47e82ccec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:17.140424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16ce41-9eef-410d-a724-40e47e82ccec None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:17.142100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 100/196] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:17.144076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ce41-9eef-410d-a724-40e47e82ccec None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.179969 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:17.207950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5521b4-f5ab-4281-abf5-95e1e06ce43a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:17.215430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:17.242447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9896cd-e099-4f4d-8644-7004256804f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:17.243087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9896cd-e099-4f4d-8644-7004256804f9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:17.243365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9896cd-e099-4f4d-8644-7004256804f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:17.243635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9896cd-e099-4f4d-8644-7004256804f9 None admin] PATH_INFO: `/v3/users/098ef422c6dd458f88be59f2860ae370` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:17.244805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9896cd-e099-4f4d-8644-7004256804f9 None admin] RBAC: Authorizing `identity:get_user(user_id=098ef422c6dd458f88be59f2860ae370)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:17.246255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9896cd-e099-4f4d-8644-7004256804f9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:17.247858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 97/197] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:17 2022] GET /identity/v3/users/098ef422c6dd458f88be59f2860ae370 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:17.248627 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9896cd-e099-4f4d-8644-7004256804f9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.257302 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ce41-9eef-410d-a724-40e47e82ccec None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:17.290313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b881-5bf1-44ec-90b5-977e131ab30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:17.290919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b881-5bf1-44ec-90b5-977e131ab30f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:17.291205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b881-5bf1-44ec-90b5-977e131ab30f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:17.291481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b881-5bf1-44ec-90b5-977e131ab30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:17.346417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9896cd-e099-4f4d-8644-7004256804f9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:17.358061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b881-5bf1-44ec-90b5-977e131ab30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:17.359518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b881-5bf1-44ec-90b5-977e131ab30f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:17.381763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ca77-fc1c-4e5d-bceb-f99693092148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:17.382413 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ca77-fc1c-4e5d-bceb-f99693092148 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:17.382690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ca77-fc1c-4e5d-bceb-f99693092148 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:17.382960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ca77-fc1c-4e5d-bceb-f99693092148 None admin] PATH_INFO: `/v3/users/d163d47c339345cb95258a74b1a042d0` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:17.384134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ca77-fc1c-4e5d-bceb-f99693092148 None admin] RBAC: Authorizing `identity:get_user(user_id=d163d47c339345cb95258a74b1a042d0)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:17.385564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ca77-fc1c-4e5d-bceb-f99693092148 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:17.387297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 98/198] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:17 2022] GET /identity/v3/users/d163d47c339345cb95258a74b1a042d0 => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:17.388340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ca77-fc1c-4e5d-bceb-f99693092148 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.403588 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:17.421339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:17.462266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 101/199] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:17.463085 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b881-5bf1-44ec-90b5-977e131ab30f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.489944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ca77-fc1c-4e5d-bceb-f99693092148 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:17.522711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f413a-ede1-4c16-a6f5-0a51aeff2416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:17.523594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f413a-ede1-4c16-a6f5-0a51aeff2416 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:17.523903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f413a-ede1-4c16-a6f5-0a51aeff2416 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:17.524178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f413a-ede1-4c16-a6f5-0a51aeff2416 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:17.524819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f413a-ede1-4c16-a6f5-0a51aeff2416 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:17.526257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f413a-ede1-4c16-a6f5-0a51aeff2416 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:17.546531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 99/200] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:17 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:17.547331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f413a-ede1-4c16-a6f5-0a51aeff2416 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.570535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b881-5bf1-44ec-90b5-977e131ab30f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:17.616711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ad119-0b61-42ca-bbce-ac1d79177350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:17.617265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ad119-0b61-42ca-bbce-ac1d79177350 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:17.617542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ad119-0b61-42ca-bbce-ac1d79177350 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:17.617820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ad119-0b61-42ca-bbce-ac1d79177350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:17.630108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:17.649646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:17.676159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f413a-ede1-4c16-a6f5-0a51aeff2416 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:17.696536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ad119-0b61-42ca-bbce-ac1d79177350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:17.698124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ad119-0b61-42ca-bbce-ac1d79177350 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:17.716225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db09b7-3193-4664-af9d-2525c5352d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:17.716852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db09b7-3193-4664-af9d-2525c5352d59 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:17.717156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db09b7-3193-4664-af9d-2525c5352d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:17.717434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db09b7-3193-4664-af9d-2525c5352d59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:17.806798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db09b7-3193-4664-af9d-2525c5352d59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:17.808308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db09b7-3193-4664-af9d-2525c5352d59 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:17.810537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 102/201] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:17.812423 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ad119-0b61-42ca-bbce-ac1d79177350 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.891749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:17.895011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:17.935068 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 100/202] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:17.935944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db09b7-3193-4664-af9d-2525c5352d59 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:17.954373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ad119-0b61-42ca-bbce-ac1d79177350 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:18.005169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83e5d9-66d0-4c2d-9241-957f1509bce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:18.006083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83e5d9-66d0-4c2d-9241-957f1509bce0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:18.006368 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83e5d9-66d0-4c2d-9241-957f1509bce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:18.006634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83e5d9-66d0-4c2d-9241-957f1509bce0 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:18.009021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83e5d9-66d0-4c2d-9241-957f1509bce0 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:18.010532 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83e5d9-66d0-4c2d-9241-957f1509bce0 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:18.013223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 103/203] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:17 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:18.016556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83e5d9-66d0-4c2d-9241-957f1509bce0 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:18.067561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db09b7-3193-4664-af9d-2525c5352d59 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:18.109433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274612-c5bc-4200-8525-3c522daa764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:18.110119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274612-c5bc-4200-8525-3c522daa764b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:18.110402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274612-c5bc-4200-8525-3c522daa764b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:18.111010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19274612-c5bc-4200-8525-3c522daa764b None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:18.112306 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19274612-c5bc-4200-8525-3c522daa764b None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:18.113861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19274612-c5bc-4200-8525-3c522daa764b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:18.115571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 101/204] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:17 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:18.120515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274612-c5bc-4200-8525-3c522daa764b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:18.136415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83e5d9-66d0-4c2d-9241-957f1509bce0 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:18.161163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:18.175622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:18.186944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59ae9-7295-499c-b640-ee490ec05f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:18.188265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59ae9-7295-499c-b640-ee490ec05f62 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:18.188550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59ae9-7295-499c-b640-ee490ec05f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:18.188828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb59ae9-7295-499c-b640-ee490ec05f62 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:18.190575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb59ae9-7295-499c-b640-ee490ec05f62 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:18.192072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb59ae9-7295-499c-b640-ee490ec05f62 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:18.194220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 104/205] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:18 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:18.195669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59ae9-7295-499c-b640-ee490ec05f62 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:18.247296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19274612-c5bc-4200-8525-3c522daa764b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:18.284316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:18.284935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:18.285273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:18.285550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:18.286294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=84031b186a7b4222a649e89146434862, user.id=098ef422c6dd458f88be59f2860ae370) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:18.286603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:18.288068 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:18.299811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 102/206] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:18 2022] GET /identity/v3/role_assignments?user.id=098ef422c6dd458f88be59f2860ae370&scope.project.id=84031b186a7b4222a649e89146434862&role.id=32319452053845419798d329f1c194d4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:18.299811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:18.347267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb59ae9-7295-499c-b640-ee490ec05f62 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:18.418522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcddd5a-6210-4835-9e55-763af4c09c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:18.419058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcddd5a-6210-4835-9e55-763af4c09c87 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:18.419337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcddd5a-6210-4835-9e55-763af4c09c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:18.419612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcddd5a-6210-4835-9e55-763af4c09c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:18.421208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcddd5a-6210-4835-9e55-763af4c09c87 None admin] RBAC: Adding query filter params (role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=84031b186a7b4222a649e89146434862, user.id=098ef422c6dd458f88be59f2860ae370) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:18.421521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcddd5a-6210-4835-9e55-763af4c09c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:18.422997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcddd5a-6210-4835-9e55-763af4c09c87 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:18.437701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 105/207] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:18 2022] GET /identity/v3/role_assignments?user.id=098ef422c6dd458f88be59f2860ae370&scope.project.id=84031b186a7b4222a649e89146434862&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:18.483632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:18.487623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e19ad-4b99-4f2c-9f23-077953c66f6b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:18.525997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c8699-6738-4920-8855-e8c44a64d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:18.526618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c8699-6738-4920-8855-e8c44a64d010 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:18.526899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c8699-6738-4920-8855-e8c44a64d010 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:18.527173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c8699-6738-4920-8855-e8c44a64d010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:18.528015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c8699-6738-4920-8855-e8c44a64d010 None admin] RBAC: Adding query filter params (role.id=198c78d869d349aebc88462da8545286, scope.project.id=331fd9a5519d4bd0a191559b4f25947e, user.id=d163d47c339345cb95258a74b1a042d0) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:18.528387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c8699-6738-4920-8855-e8c44a64d010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:18.529881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c8699-6738-4920-8855-e8c44a64d010 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:18.538153 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 103/208] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:18 2022] GET /identity/v3/role_assignments?user.id=d163d47c339345cb95258a74b1a042d0&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=198c78d869d349aebc88462da8545286 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:19.697695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4edb9-2b46-47cc-80d1-0b953d9bdedd None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:19.698209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4edb9-2b46-47cc-80d1-0b953d9bdedd None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:19.698313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4edb9-2b46-47cc-80d1-0b953d9bdedd None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:19.699855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 106/209] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:19.705341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a969cc-d286-4669-a46b-7b27cf775f1a None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:19.705778 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a969cc-d286-4669-a46b-7b27cf775f1a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:19.705951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a969cc-d286-4669-a46b-7b27cf775f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:19.725598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-25a969cc-d286-4669-a46b-7b27cf775f1a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:19.726876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-25a969cc-d286-4669-a46b-7b27cf775f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:19.796694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 104/210] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:19.996017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1a94-b6e1-43f9-adab-7becf2e05c4f None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:19.996334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1a94-b6e1-43f9-adab-7becf2e05c4f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:19.996600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1a94-b6e1-43f9-adab-7becf2e05c4f None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:19.997950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 107/211] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:20.003186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8447-efd6-4c57-904d-a2c0d8fc9bcb None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.003475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8447-efd6-4c57-904d-a2c0d8fc9bcb None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.003753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8447-efd6-4c57-904d-a2c0d8fc9bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.022429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-e85e8447-efd6-4c57-904d-a2c0d8fc9bcb None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:20.023982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-e85e8447-efd6-4c57-904d-a2c0d8fc9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:20.083829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b1a94-b6e1-43f9-adab-7becf2e05c4f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:20.094547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 105/212] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:20.149611 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:20.192096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b1a94-b6e1-43f9-adab-7becf2e05c4f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:20.231732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3f2c9-ac58-466e-a342-ec7fdb09e4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:20.232706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3f2c9-ac58-466e-a342-ec7fdb09e4df None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.233184 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3f2c9-ac58-466e-a342-ec7fdb09e4df None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.233654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3f2c9-ac58-466e-a342-ec7fdb09e4df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.244850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3f2c9-ac58-466e-a342-ec7fdb09e4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-acf3f2c9-ac58-466e-a342-ec7fdb09e4df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:20.249968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:20.250891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:20.251725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:20.254059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 108/213] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:20.263798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e8447-efd6-4c57-904d-a2c0d8fc9bcb None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:20.288003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:20.365804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e8447-efd6-4c57-904d-a2c0d8fc9bcb None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:20.404068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3f2c9-ac58-466e-a342-ec7fdb09e4df None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:20.406428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:20.407053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.407460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.407735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.408549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] RBAC: Adding query filter params (name=member) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:20.408913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:20.410360 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:20.420534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 106/214] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:20.425572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:20.515253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3f2c9-ac58-466e-a342-ec7fdb09e4df None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:20.521392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:20.535553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:20.540854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498403f-4066-413d-a58c-aa89df3bf891 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:20.550365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e9f10-52fa-4655-9f8f-58354866cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:20.550998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e9f10-52fa-4655-9f8f-58354866cd6e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.551269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e9f10-52fa-4655-9f8f-58354866cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.551540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e9f10-52fa-4655-9f8f-58354866cd6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.552677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e9f10-52fa-4655-9f8f-58354866cd6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:20.554119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e9f10-52fa-4655-9f8f-58354866cd6e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:20.556270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 109/215] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:20.557373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffc54e-f917-4ed8-9ba6-36d1b607a868 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.557651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffc54e-f917-4ed8-9ba6-36d1b607a868 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.557920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffc54e-f917-4ed8-9ba6-36d1b607a868 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.559280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 110/216] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:20.564199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffc54e-f917-4ed8-9ba6-36d1b607a868 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:20.580424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b6ef2-ddae-408f-9bf2-d611a1ece75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:20.581367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b6ef2-ddae-408f-9bf2-d611a1ece75c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.581815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b6ef2-ddae-408f-9bf2-d611a1ece75c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.582266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b6ef2-ddae-408f-9bf2-d611a1ece75c None admin] PATH_INFO: `/v3/users/9bc66494910a4da6ad15bd1809f500d2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.596425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b6ef2-ddae-408f-9bf2-d611a1ece75c None admin] RBAC: Authorizing `identity:get_user(user_id=9bc66494910a4da6ad15bd1809f500d2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:20.597959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b6ef2-ddae-408f-9bf2-d611a1ece75c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:20.600167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 107/217] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:20 2022] GET /identity/v3/users/9bc66494910a4da6ad15bd1809f500d2 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:20.601874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3c7f-4e1c-4f3e-adb9-d796e1dff9e3 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.602151 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3c7f-4e1c-4f3e-adb9-d796e1dff9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.602418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f3c7f-4e1c-4f3e-adb9-d796e1dff9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.620022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-759f3c7f-4e1c-4f3e-adb9-d796e1dff9e3 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:20.621185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-759f3c7f-4e1c-4f3e-adb9-d796e1dff9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:20.670917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffc54e-f917-4ed8-9ba6-36d1b607a868 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:20.686928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 108/218] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:20.687749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f3c7f-4e1c-4f3e-adb9-d796e1dff9e3 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:20.705129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e6d22-c210-4d10-be61-f8c29e9f7bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:20.705747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6d22-c210-4d10-be61-f8c29e9f7bd4 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.706057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6d22-c210-4d10-be61-f8c29e9f7bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.706308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6d22-c210-4d10-be61-f8c29e9f7bd4 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.706960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e6d22-c210-4d10-be61-f8c29e9f7bd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:20.708466 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e6d22-c210-4d10-be61-f8c29e9f7bd4 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:20.731625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 111/219] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:20 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:20.732867 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aae7e-dccd-4145-9ea0-339923b0cd01 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.733156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aae7e-dccd-4145-9ea0-339923b0cd01 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.733428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aae7e-dccd-4145-9ea0-339923b0cd01 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.734852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 112/220] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:20.740837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca156c-fe30-4a65-bea2-48d314f38c3f None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.741137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca156c-fe30-4a65-bea2-48d314f38c3f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.741379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca156c-fe30-4a65-bea2-48d314f38c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.760885 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-99ca156c-fe30-4a65-bea2-48d314f38c3f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:20.762099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-99ca156c-fe30-4a65-bea2-48d314f38c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:20.789774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:20.818914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f3c7f-4e1c-4f3e-adb9-d796e1dff9e3 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:20.819364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:20.860690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 113/221] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:20.864585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee3e95-4f0a-42e6-b09c-2076a2000b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:20.865491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee3e95-4f0a-42e6-b09c-2076a2000b78 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:20.866016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee3e95-4f0a-42e6-b09c-2076a2000b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:20.866500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee3e95-4f0a-42e6-b09c-2076a2000b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:20.939593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee3e95-4f0a-42e6-b09c-2076a2000b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:20.941091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee3e95-4f0a-42e6-b09c-2076a2000b78 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:20.961436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca156c-fe30-4a65-bea2-48d314f38c3f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.037532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:21.066387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 109/222] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:21.073242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee3e95-4f0a-42e6-b09c-2076a2000b78 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.089879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca156c-fe30-4a65-bea2-48d314f38c3f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.130260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b739d-026a-401f-8e68-e7d5100665c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.131269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b739d-026a-401f-8e68-e7d5100665c5 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.131747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b739d-026a-401f-8e68-e7d5100665c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.132269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b739d-026a-401f-8e68-e7d5100665c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.148804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b739d-026a-401f-8e68-e7d5100665c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-d37b739d-026a-401f-8e68-e7d5100665c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:21.154028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:21.154931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:21.155718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:21.158077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 114/223] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:21.159089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b739d-026a-401f-8e68-e7d5100665c5 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.192994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee3e95-4f0a-42e6-b09c-2076a2000b78 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.202167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:21.231448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd039515-bd0d-4e82-8ea7-a8c80b3dedb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.232122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd039515-bd0d-4e82-8ea7-a8c80b3dedb9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.232402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd039515-bd0d-4e82-8ea7-a8c80b3dedb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.232674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd039515-bd0d-4e82-8ea7-a8c80b3dedb9 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.233820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd039515-bd0d-4e82-8ea7-a8c80b3dedb9 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:21.235270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd039515-bd0d-4e82-8ea7-a8c80b3dedb9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:21.237264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 110/224] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:21.238142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd039515-bd0d-4e82-8ea7-a8c80b3dedb9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.285028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:21.297022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b739d-026a-401f-8e68-e7d5100665c5 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.346519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611736f9-0f36-44ff-bb3e-b84e7e9b2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.347824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611736f9-0f36-44ff-bb3e-b84e7e9b2f66 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.348333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611736f9-0f36-44ff-bb3e-b84e7e9b2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.348941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611736f9-0f36-44ff-bb3e-b84e7e9b2f66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.352551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd039515-bd0d-4e82-8ea7-a8c80b3dedb9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.364810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611736f9-0f36-44ff-bb3e-b84e7e9b2f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-611736f9-0f36-44ff-bb3e-b84e7e9b2f66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:21.372490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:21.373378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:21.374185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:21.377487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 115/225] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:21.378678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611736f9-0f36-44ff-bb3e-b84e7e9b2f66 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.390658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.391298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.391899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.391899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.392513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:21.392816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:21.394218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:21.403116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 111/226] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:21.404031 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.492458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:21.500577 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611736f9-0f36-44ff-bb3e-b84e7e9b2f66 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.510853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eb0f0-0234-40f9-a2ff-639823e1dbab None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.513112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:21.540363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.541510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.541995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.542470 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.543400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] RBAC: Adding query filter params (role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=84031b186a7b4222a649e89146434862, user.id=9bc66494910a4da6ad15bd1809f500d2) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:21.543958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:21.545631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:21.546796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.547411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.547693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.548012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.548681 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:21.548985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:21.550369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:21.553187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 116/227] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/role_assignments?user.id=9bc66494910a4da6ad15bd1809f500d2&scope.project.id=84031b186a7b4222a649e89146434862&role.id=4367ece899d646eeb2e2917530897f7f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:21.554709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.560742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 112/228] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:21.573095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.669977 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830554a7-5d4c-4ba7-8bd4-f72a0130e6ae None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.708268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaa7bb-50f6-4d4e-88be-4e52a11717dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.709735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa7bb-50f6-4d4e-88be-4e52a11717dc None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.710448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa7bb-50f6-4d4e-88be-4e52a11717dc None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.710945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa7bb-50f6-4d4e-88be-4e52a11717dc None admin] PATH_INFO: `/v3/users/098ef422c6dd458f88be59f2860ae370` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.712435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaa7bb-50f6-4d4e-88be-4e52a11717dc None admin] RBAC: Authorizing `identity:get_user(user_id=098ef422c6dd458f88be59f2860ae370)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:21.714150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaa7bb-50f6-4d4e-88be-4e52a11717dc None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:21.716126 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 117/229] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/users/098ef422c6dd458f88be59f2860ae370 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:21.724854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaa7bb-50f6-4d4e-88be-4e52a11717dc None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.763293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:21.772350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6c09a-d003-475a-bc49-f10207044bc4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.808084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7efed-d804-4428-bf58-ec1ebf654f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.808695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7efed-d804-4428-bf58-ec1ebf654f9a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.809021 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7efed-d804-4428-bf58-ec1ebf654f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.809304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7efed-d804-4428-bf58-ec1ebf654f9a None admin] PATH_INFO: `/v3/users/098ef422c6dd458f88be59f2860ae370` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.810445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7efed-d804-4428-bf58-ec1ebf654f9a None admin] RBAC: Authorizing `identity:get_user(user_id=098ef422c6dd458f88be59f2860ae370)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:21.812431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7efed-d804-4428-bf58-ec1ebf654f9a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:21.813669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 113/230] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/users/098ef422c6dd458f88be59f2860ae370 => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:21.818903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7efed-d804-4428-bf58-ec1ebf654f9a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.845799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaa7bb-50f6-4d4e-88be-4e52a11717dc None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.856420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:21.884384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc88c-53bf-4ea3-ad83-28639bfb0a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.885529 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc88c-53bf-4ea3-ad83-28639bfb0a62 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.886148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc88c-53bf-4ea3-ad83-28639bfb0a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.886637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc88c-53bf-4ea3-ad83-28639bfb0a62 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.894229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edc88c-53bf-4ea3-ad83-28639bfb0a62 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:21.896418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edc88c-53bf-4ea3-ad83-28639bfb0a62 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:21.898609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 118/231] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:21.905362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc88c-53bf-4ea3-ad83-28639bfb0a62 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:21.930194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7efed-d804-4428-bf58-ec1ebf654f9a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:21.974815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ecb4e-049f-47fc-aabc-73b2366853e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:21.975462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ecb4e-049f-47fc-aabc-73b2366853e8 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:21.975741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ecb4e-049f-47fc-aabc-73b2366853e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:21.976040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ecb4e-049f-47fc-aabc-73b2366853e8 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:21.980530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ecb4e-049f-47fc-aabc-73b2366853e8 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:21.982067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ecb4e-049f-47fc-aabc-73b2366853e8 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:21.983726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 114/232] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:21 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:21.991402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ecb4e-049f-47fc-aabc-73b2366853e8 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:22.088381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:22.113930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc88c-53bf-4ea3-ad83-28639bfb0a62 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:22.142245 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ecb4e-049f-47fc-aabc-73b2366853e8 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:22.145201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:22.192802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1c3d7-8379-4b10-bbfc-733429f160f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:22.193389 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c3d7-8379-4b10-bbfc-733429f160f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:22.193670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c3d7-8379-4b10-bbfc-733429f160f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:22.193947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1c3d7-8379-4b10-bbfc-733429f160f2 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862/users/098ef422c6dd458f88be59f2860ae370/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:22.197085 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1c3d7-8379-4b10-bbfc-733429f160f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=84031b186a7b4222a649e89146434862, user_id=098ef422c6dd458f88be59f2860ae370, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:22.198592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1c3d7-8379-4b10-bbfc-733429f160f2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:22.205541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc1e56-783d-49cf-8d6f-b35220d2a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:22.206216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc1e56-783d-49cf-8d6f-b35220d2a5c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:22.206498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc1e56-783d-49cf-8d6f-b35220d2a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:22.206774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc1e56-783d-49cf-8d6f-b35220d2a5c2 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862/users/098ef422c6dd458f88be59f2860ae370/roles/a37614139c1f4c259c28b64ce0a959a2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:22.210030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc1e56-783d-49cf-8d6f-b35220d2a5c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=84031b186a7b4222a649e89146434862, user_id=098ef422c6dd458f88be59f2860ae370, role_id=a37614139c1f4c259c28b64ce0a959a2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:22.212301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc1e56-783d-49cf-8d6f-b35220d2a5c2 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:22.230334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 119/233] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:21 2022] PUT /identity/v3/projects/84031b186a7b4222a649e89146434862/users/098ef422c6dd458f88be59f2860ae370/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:22.240833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 115/234] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:21 2022] PUT /identity/v3/projects/84031b186a7b4222a649e89146434862/users/098ef422c6dd458f88be59f2860ae370/roles/a37614139c1f4c259c28b64ce0a959a2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:23.154847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823fd25-a344-4de9-bd10-eab9526822e2 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:23.155900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823fd25-a344-4de9-bd10-eab9526822e2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:23.156386 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823fd25-a344-4de9-bd10-eab9526822e2 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:23.157922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 120/235] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:23.163278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0e1b-cced-4159-ae1d-acbc4ac60f38 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:23.164169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0e1b-cced-4159-ae1d-acbc4ac60f38 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:23.164659 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0e1b-cced-4159-ae1d-acbc4ac60f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:23.183491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-b57a0e1b-cced-4159-ae1d-acbc4ac60f38 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:23.185045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b57a0e1b-cced-4159-ae1d-acbc4ac60f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:23.262396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 116/236] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:23.287027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db536b-f40c-444a-ba4b-0f9a25c6912e None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:23.287659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db536b-f40c-444a-ba4b-0f9a25c6912e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:23.288152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db536b-f40c-444a-ba4b-0f9a25c6912e None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:23.290192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 121/237] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:23.295330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361f43-ba27-4e48-9bdc-888ddf618e84 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:23.295620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361f43-ba27-4e48-9bdc-888ddf618e84 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:23.295934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361f43-ba27-4e48-9bdc-888ddf618e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:23.314749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-4d361f43-ba27-4e48-9bdc-888ddf618e84 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:23.316001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4d361f43-ba27-4e48-9bdc-888ddf618e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:23.404274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 117/238] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:23.589224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db536b-f40c-444a-ba4b-0f9a25c6912e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:23.723591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d361f43-ba27-4e48-9bdc-888ddf618e84 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:23.735737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db536b-f40c-444a-ba4b-0f9a25c6912e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:23.756120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:23.802784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c9208-a56a-4a62-8d3b-70817946c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:23.803430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c9208-a56a-4a62-8d3b-70817946c981 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:23.803708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c9208-a56a-4a62-8d3b-70817946c981 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:23.804076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c9208-a56a-4a62-8d3b-70817946c981 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:23.824978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c9208-a56a-4a62-8d3b-70817946c981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-023c9208-a56a-4a62-8d3b-70817946c981 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:23.834413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:23.836098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:23.837101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:23.844377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 122/239] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:23.858281 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c9208-a56a-4a62-8d3b-70817946c981 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:23.882912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:23.893156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d361f43-ba27-4e48-9bdc-888ddf618e84 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:23.929228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f87b9-bf1e-400e-9b72-e792df15bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:23.929926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f87b9-bf1e-400e-9b72-e792df15bbbe None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:23.930213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f87b9-bf1e-400e-9b72-e792df15bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:23.930504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f87b9-bf1e-400e-9b72-e792df15bbbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:23.936954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f87b9-bf1e-400e-9b72-e792df15bbbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:23.938417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f87b9-bf1e-400e-9b72-e792df15bbbe None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:23.940319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 118/240] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:23.946165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f87b9-bf1e-400e-9b72-e792df15bbbe None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:24.036060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c9208-a56a-4a62-8d3b-70817946c981 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:24.058177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:24.070046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f87b9-bf1e-400e-9b72-e792df15bbbe None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:24.082537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a598ccf-0745-4a22-becc-db1119ecab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:24.083608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598ccf-0745-4a22-becc-db1119ecab19 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.083919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598ccf-0745-4a22-becc-db1119ecab19 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.084195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598ccf-0745-4a22-becc-db1119ecab19 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.085275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a598ccf-0745-4a22-becc-db1119ecab19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:24.085749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a598ccf-0745-4a22-becc-db1119ecab19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:24.087523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a598ccf-0745-4a22-becc-db1119ecab19 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:24.098628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 123/241] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:24.099881 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6520b4-7b23-4c37-8f4b-8eba6b648797 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.100166 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6520b4-7b23-4c37-8f4b-8eba6b648797 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.100437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6520b4-7b23-4c37-8f4b-8eba6b648797 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.102353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 124/242] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:24.107600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6520b4-7b23-4c37-8f4b-8eba6b648797 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:24.119515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600fdf-5d7a-47ad-89c9-d04c8b82ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:24.120173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600fdf-5d7a-47ad-89c9-d04c8b82ea7d None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.120456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600fdf-5d7a-47ad-89c9-d04c8b82ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.120731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600fdf-5d7a-47ad-89c9-d04c8b82ea7d None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.121833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4600fdf-5d7a-47ad-89c9-d04c8b82ea7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:24.124076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4600fdf-5d7a-47ad-89c9-d04c8b82ea7d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:24.152966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 119/243] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:23 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:24.154270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693040e-8a74-4949-9b65-bddaa974b235 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.154612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693040e-8a74-4949-9b65-bddaa974b235 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.154894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693040e-8a74-4949-9b65-bddaa974b235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.181844 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7693040e-8a74-4949-9b65-bddaa974b235 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:24.183076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7693040e-8a74-4949-9b65-bddaa974b235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:24.235537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:24.269272 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 120/244] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:24.301716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6520b4-7b23-4c37-8f4b-8eba6b648797 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:24.371255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9ab07-ead0-4e4b-a061-c009fa4ee42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:24.371851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ab07-ead0-4e4b-a061-c009fa4ee42d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.372132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ab07-ead0-4e4b-a061-c009fa4ee42d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.372402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ab07-ead0-4e4b-a061-c009fa4ee42d None admin] PATH_INFO: `/v3/users/f0cc6f79c27d4ae1967a09aeb30be50b` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.387000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9ab07-ead0-4e4b-a061-c009fa4ee42d None admin] RBAC: Authorizing `identity:get_user(user_id=f0cc6f79c27d4ae1967a09aeb30be50b)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:24.388577 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9ab07-ead0-4e4b-a061-c009fa4ee42d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:24.390560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 125/245] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:24 2022] GET /identity/v3/users/f0cc6f79c27d4ae1967a09aeb30be50b => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:24.396109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693040e-8a74-4949-9b65-bddaa974b235 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:24.478147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:24.505551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693040e-8a74-4949-9b65-bddaa974b235 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:24.542757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e5a4-858a-47d4-8c61-bd41d64b3eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:24.543723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e5a4-858a-47d4-8c61-bd41d64b3eed None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.544237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e5a4-858a-47d4-8c61-bd41d64b3eed None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.544696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e5a4-858a-47d4-8c61-bd41d64b3eed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.569356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfffbf-c2b4-4a6f-823e-a708ab206acf None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.569998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfffbf-c2b4-4a6f-823e-a708ab206acf None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.570464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfffbf-c2b4-4a6f-823e-a708ab206acf None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.573192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 126/246] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:24.578922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4509-6074-42da-ae67-52e2a4274ed8 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.579439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4509-6074-42da-ae67-52e2a4274ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.579953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4509-6074-42da-ae67-52e2a4274ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.606221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-444c4509-6074-42da-ae67-52e2a4274ed8 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:24.607428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-444c4509-6074-42da-ae67-52e2a4274ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:24.629768 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854e5a4-858a-47d4-8c61-bd41d64b3eed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:24.633273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854e5a4-858a-47d4-8c61-bd41d64b3eed None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:24.689471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 127/247] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:24.690634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c4509-6074-42da-ae67-52e2a4274ed8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:24.727546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:24.755726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 121/248] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:24.761942 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e5a4-858a-47d4-8c61-bd41d64b3eed None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:24.769850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:24.815637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c4509-6074-42da-ae67-52e2a4274ed8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:24.859765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac93b9-f605-43ee-9211-ed7841ecf8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:24.860447 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac93b9-f605-43ee-9211-ed7841ecf8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.860726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac93b9-f605-43ee-9211-ed7841ecf8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.860996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac93b9-f605-43ee-9211-ed7841ecf8d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.876432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac93b9-f605-43ee-9211-ed7841ecf8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:24.880520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e5a4-858a-47d4-8c61-bd41d64b3eed None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-e8ac93b9-f605-43ee-9211-ed7841ecf8d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:24.882985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:24.883878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:24.884667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:24.885343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 128/249] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:24.887320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf0b40-3679-4a55-9663-fd836849d767 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.887598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf0b40-3679-4a55-9663-fd836849d767 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.891261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf0b40-3679-4a55-9663-fd836849d767 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.891261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 129/250] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:24.892673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf0b40-3679-4a55-9663-fd836849d767 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:24.931640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b27fd-9cfd-40b3-808e-a77289344387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:24.932335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b27fd-9cfd-40b3-808e-a77289344387 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.932621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b27fd-9cfd-40b3-808e-a77289344387 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.932906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b27fd-9cfd-40b3-808e-a77289344387 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.934147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b27fd-9cfd-40b3-808e-a77289344387 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:24.935666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b27fd-9cfd-40b3-808e-a77289344387 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:24.938470 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 122/251] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:24 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:24.939052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2bba9-92bf-49b8-896b-6eb67486a1b2 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:24.939343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2bba9-92bf-49b8-896b-6eb67486a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:24.939665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2bba9-92bf-49b8-896b-6eb67486a1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:24.961154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-01a2bba9-92bf-49b8-896b-6eb67486a1b2 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:24.961459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-01a2bba9-92bf-49b8-896b-6eb67486a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:25.005735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.018727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf0b40-3679-4a55-9663-fd836849d767 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.037488 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 123/252] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:25.038355 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2bba9-92bf-49b8-896b-6eb67486a1b2 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.052170 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.060456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.061282 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.061744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.062324 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.063206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:25.063723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.065663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.076310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 130/253] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:25.077556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.177760 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2bba9-92bf-49b8-896b-6eb67486a1b2 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.242941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.243589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.243865 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.244297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.244890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] RBAC: Adding query filter params (role.id=198c78d869d349aebc88462da8545286, scope.project.id=84031b186a7b4222a649e89146434862, user.id=f0cc6f79c27d4ae1967a09aeb30be50b) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:25.245200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.246664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.247214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc82ff-a177-4e33-a310-278491cb1201 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.262857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 124/254] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/role_assignments?user.id=f0cc6f79c27d4ae1967a09aeb30be50b&scope.project.id=84031b186a7b4222a649e89146434862&role.id=198c78d869d349aebc88462da8545286 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:25.263761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.341366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4506-3920-445d-ac4f-4f4742f7a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.342007 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4506-3920-445d-ac4f-4f4742f7a886 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.342283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4506-3920-445d-ac4f-4f4742f7a886 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.342554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d4506-3920-445d-ac4f-4f4742f7a886 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.343364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.369865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d4506-3920-445d-ac4f-4f4742f7a886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-3a4d4506-3920-445d-ac4f-4f4742f7a886 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:25.375362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:25.376290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:25.377231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 131/255] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:25.385268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4506-3920-445d-ac4f-4f4742f7a886 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.444891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.504865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d4506-3920-445d-ac4f-4f4742f7a886 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.519532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de2643-8199-41ca-8a36-8ef74643c7a0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.543699 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.544605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.544905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.545178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.545844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:25.546147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.547995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.559187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 132/256] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:25.560483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.564886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c452a8-ad31-4253-9485-f94434d204bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.565544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c452a8-ad31-4253-9485-f94434d204bd None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.565822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c452a8-ad31-4253-9485-f94434d204bd None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.566101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c452a8-ad31-4253-9485-f94434d204bd None admin] PATH_INFO: `/v3/users/9bc66494910a4da6ad15bd1809f500d2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.567844 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c452a8-ad31-4253-9485-f94434d204bd None admin] RBAC: Authorizing `identity:get_user(user_id=9bc66494910a4da6ad15bd1809f500d2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.569323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c452a8-ad31-4253-9485-f94434d204bd None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.573684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 125/257] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/users/9bc66494910a4da6ad15bd1809f500d2 => generated 297 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:25.574556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c452a8-ad31-4253-9485-f94434d204bd None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.708387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c452a8-ad31-4253-9485-f94434d204bd None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.736187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.744121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d356c90-ee34-48cb-8812-72b12f47f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.744756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d356c90-ee34-48cb-8812-72b12f47f833 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.745084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d356c90-ee34-48cb-8812-72b12f47f833 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.745368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d356c90-ee34-48cb-8812-72b12f47f833 None admin] PATH_INFO: `/v3/users/098ef422c6dd458f88be59f2860ae370` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.746761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d356c90-ee34-48cb-8812-72b12f47f833 None admin] RBAC: Authorizing `identity:get_user(user_id=098ef422c6dd458f88be59f2860ae370)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.748341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d356c90-ee34-48cb-8812-72b12f47f833 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.750262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 126/258] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/users/098ef422c6dd458f88be59f2860ae370 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:25.750820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d356c90-ee34-48cb-8812-72b12f47f833 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.784429 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb335a-81e0-444f-b342-3f860fb1ae88 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.801634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:25.852448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d356c90-ee34-48cb-8812-72b12f47f833 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:25.856149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027c6a1-adbd-43ae-9add-df0b767258c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.856794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027c6a1-adbd-43ae-9add-df0b767258c3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.857071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027c6a1-adbd-43ae-9add-df0b767258c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.857331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027c6a1-adbd-43ae-9add-df0b767258c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.882992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027c6a1-adbd-43ae-9add-df0b767258c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a027c6a1-adbd-43ae-9add-df0b767258c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:25.888301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:25.889190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:25.889999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:25.894068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 133/259] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:25.895734 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027c6a1-adbd-43ae-9add-df0b767258c3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.901025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd54136-61b9-4ff9-8fbe-79f77f3bcf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:25.901666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54136-61b9-4ff9-8fbe-79f77f3bcf00 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:25.901944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54136-61b9-4ff9-8fbe-79f77f3bcf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:25.902256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54136-61b9-4ff9-8fbe-79f77f3bcf00 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:25.904103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd54136-61b9-4ff9-8fbe-79f77f3bcf00 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:25.905553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd54136-61b9-4ff9-8fbe-79f77f3bcf00 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:25.907267 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 127/260] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:25.908048 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd54136-61b9-4ff9-8fbe-79f77f3bcf00 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:25.958891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:26.019521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd54136-61b9-4ff9-8fbe-79f77f3bcf00 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:26.057498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:26.058131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:26.058414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:26.058694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:26.059381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:26.059752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:26.061197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:26.072107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 128/261] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:26.072733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:26.127673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027c6a1-adbd-43ae-9add-df0b767258c3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:26.176754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26058b-7042-42f8-9335-0d617712805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:26.177372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26058b-7042-42f8-9335-0d617712805b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:26.177646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26058b-7042-42f8-9335-0d617712805b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:26.177914 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26058b-7042-42f8-9335-0d617712805b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:26.184319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da92df-780e-4b09-957b-295d3e6b9916 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:26.200169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:26.220355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:26.248123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26058b-7042-42f8-9335-0d617712805b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:26.250378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26058b-7042-42f8-9335-0d617712805b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:26.260827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6bcb9-981a-4c98-b0b6-62459ee5e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:26.261508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bcb9-981a-4c98-b0b6-62459ee5e1e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:26.261794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bcb9-981a-4c98-b0b6-62459ee5e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:26.262080 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6bcb9-981a-4c98-b0b6-62459ee5e1e9 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862/users/9bc66494910a4da6ad15bd1809f500d2/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:26.265513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6bcb9-981a-4c98-b0b6-62459ee5e1e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=84031b186a7b4222a649e89146434862, user_id=9bc66494910a4da6ad15bd1809f500d2, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:26.266981 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6bcb9-981a-4c98-b0b6-62459ee5e1e9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:26.305867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 129/262] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:26 2022] PUT /identity/v3/projects/84031b186a7b4222a649e89146434862/users/9bc66494910a4da6ad15bd1809f500d2/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:26.306752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6bcb9-981a-4c98-b0b6-62459ee5e1e9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:26.355818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 134/263] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:26.361185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26058b-7042-42f8-9335-0d617712805b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:26.440192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:26.464786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26058b-7042-42f8-9335-0d617712805b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:26.500664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c423a-c689-4b9c-8769-6d9397bbab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:26.501231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c423a-c689-4b9c-8769-6d9397bbab82 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:26.501509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c423a-c689-4b9c-8769-6d9397bbab82 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:26.501778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c423a-c689-4b9c-8769-6d9397bbab82 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:26.502922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c423a-c689-4b9c-8769-6d9397bbab82 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:26.503975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6bcb9-981a-4c98-b0b6-62459ee5e1e9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:26.504427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c423a-c689-4b9c-8769-6d9397bbab82 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:26.506369 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 135/264] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:26 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:26.513829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c423a-c689-4b9c-8769-6d9397bbab82 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:26.574720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3dcc9-e5ff-4cfd-a443-7037ed2f57c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:26.575386 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3dcc9-e5ff-4cfd-a443-7037ed2f57c3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:26.575712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3dcc9-e5ff-4cfd-a443-7037ed2f57c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:26.576020 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3dcc9-e5ff-4cfd-a443-7037ed2f57c3 None admin] PATH_INFO: `/v3/users/098ef422c6dd458f88be59f2860ae370` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:26.580566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3dcc9-e5ff-4cfd-a443-7037ed2f57c3 None admin] RBAC: Authorizing `identity:get_user(user_id=098ef422c6dd458f88be59f2860ae370)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:26.582057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3dcc9-e5ff-4cfd-a443-7037ed2f57c3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:26.584130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 130/265] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:26 2022] GET /identity/v3/users/098ef422c6dd458f88be59f2860ae370 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:26.589886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3dcc9-e5ff-4cfd-a443-7037ed2f57c3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:26.656220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:26.672832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c423a-c689-4b9c-8769-6d9397bbab82 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:26.751043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:26.752870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:26.754111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3dcc9-e5ff-4cfd-a443-7037ed2f57c3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:26.754587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:26.755050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:26.756004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] RBAC: Adding query filter params (role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=84031b186a7b4222a649e89146434862, user.id=098ef422c6dd458f88be59f2860ae370) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:26.758596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:26.760318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:26.770194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:26.775364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 136/266] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:26 2022] GET /identity/v3/role_assignments?user.id=098ef422c6dd458f88be59f2860ae370&scope.project.id=84031b186a7b4222a649e89146434862&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:26.803177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed1734-ebce-4f70-8218-bcbdb48f8d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:26.804740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1734-ebce-4f70-8218-bcbdb48f8d48 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:26.805244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1734-ebce-4f70-8218-bcbdb48f8d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:26.805710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed1734-ebce-4f70-8218-bcbdb48f8d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:26.897109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed1734-ebce-4f70-8218-bcbdb48f8d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:26.899255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed1734-ebce-4f70-8218-bcbdb48f8d48 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:26.946595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:27.055747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 131/267] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:29:27.061671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:27.182518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b5262-f61e-4a02-a09a-84a403c33c6a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:27.225921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910953bd-cb8a-4c77-b05b-9a0f37fdcd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:27.227503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910953bd-cb8a-4c77-b05b-9a0f37fdcd1a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.229203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8e20-b5eb-4cec-a50e-9f86bf81fa79 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.229686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8e20-b5eb-4cec-a50e-9f86bf81fa79 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.230200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8e20-b5eb-4cec-a50e-9f86bf81fa79 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.232011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 132/268] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:27.233282 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc289e-72f3-427d-ad9e-602a32fae14e None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.233561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc289e-72f3-427d-ad9e-602a32fae14e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.233832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc289e-72f3-427d-ad9e-602a32fae14e None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.235157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 133/269] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:27.235383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910953bd-cb8a-4c77-b05b-9a0f37fdcd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.235654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910953bd-cb8a-4c77-b05b-9a0f37fdcd1a None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.236971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b6d93-9849-48aa-87e2-4ab6c7f947a6 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.237244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b6d93-9849-48aa-87e2-4ab6c7f947a6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.237511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b6d93-9849-48aa-87e2-4ab6c7f947a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.241296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910953bd-cb8a-4c77-b05b-9a0f37fdcd1a None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:27.243443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910953bd-cb8a-4c77-b05b-9a0f37fdcd1a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:27.245328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 137/270] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:27 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:27.246318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1fbaf-a317-4e8c-97f6-961b21564694 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.246605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1fbaf-a317-4e8c-97f6-961b21564694 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.246858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1fbaf-a317-4e8c-97f6-961b21564694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.261539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-cc1b6d93-9849-48aa-87e2-4ab6c7f947a6 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:27.263392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-cc1b6d93-9849-48aa-87e2-4ab6c7f947a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:27.275799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6aa1fbaf-a317-4e8c-97f6-961b21564694 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:27.275799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6aa1fbaf-a317-4e8c-97f6-961b21564694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:27.357963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:27.365800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 134/271] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:27.367027 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b6d93-9849-48aa-87e2-4ab6c7f947a6 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:27.368156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 138/272] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:27.432078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:27.473924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b6d93-9849-48aa-87e2-4ab6c7f947a6 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:27.512998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:27.513956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.514462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.514950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.515924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=84031b186a7b4222a649e89146434862, user.id=098ef422c6dd458f88be59f2860ae370) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:27.516433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:27.518075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:27.525138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 135/273] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:27 2022] GET /identity/v3/role_assignments?user.id=098ef422c6dd458f88be59f2860ae370&scope.project.id=84031b186a7b4222a649e89146434862&role.id=32319452053845419798d329f1c194d4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:27.678145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1fbaf-a317-4e8c-97f6-961b21564694 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:27.740143 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:27.794899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1fbaf-a317-4e8c-97f6-961b21564694 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:27.832782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae9ef-9958-443b-8a7f-21827db61272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:27.833421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae9ef-9958-443b-8a7f-21827db61272 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.833699 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae9ef-9958-443b-8a7f-21827db61272 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.833971 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae9ef-9958-443b-8a7f-21827db61272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.836438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ae9ef-9958-443b-8a7f-21827db61272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:27.837907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ae9ef-9958-443b-8a7f-21827db61272 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:27.843881 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 139/274] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:27.845233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae9ef-9958-443b-8a7f-21827db61272 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:27.871808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c924b-f370-4836-a78e-62e4c199f0e9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:27.902802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:27.917770 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:27.921595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eba2f3-0515-4d4a-85ec-7a32b98638c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:27.922247 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eba2f3-0515-4d4a-85ec-7a32b98638c2 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.922525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eba2f3-0515-4d4a-85ec-7a32b98638c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.922803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eba2f3-0515-4d4a-85ec-7a32b98638c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.934093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eba2f3-0515-4d4a-85ec-7a32b98638c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-83eba2f3-0515-4d4a-85ec-7a32b98638c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:27.939314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:27.940232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:27.941036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:27.943562 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 136/275] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:27.949019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2aa21-9f2d-45c2-8d1c-f997f22e1d37 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:27.949771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2aa21-9f2d-45c2-8d1c-f997f22e1d37 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:27.949771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2aa21-9f2d-45c2-8d1c-f997f22e1d37 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:27.951045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 137/276] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:27.953821 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2aa21-9f2d-45c2-8d1c-f997f22e1d37 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:27.970244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae9ef-9958-443b-8a7f-21827db61272 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:28.007715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6a7f7-7253-4b25-b9ef-964ea27e6194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:28.008465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a7f7-7253-4b25-b9ef-964ea27e6194 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.008746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a7f7-7253-4b25-b9ef-964ea27e6194 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.009016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a7f7-7253-4b25-b9ef-964ea27e6194 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.009660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6a7f7-7253-4b25-b9ef-964ea27e6194 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:28.011116 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6a7f7-7253-4b25-b9ef-964ea27e6194 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:28.033796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 140/277] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:27 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:29:28.038222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc628e-60ff-4e51-a1b9-df75401fbb8f None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.038663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc628e-60ff-4e51-a1b9-df75401fbb8f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.039064 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc628e-60ff-4e51-a1b9-df75401fbb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.066616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-e8fc628e-60ff-4e51-a1b9-df75401fbb8f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:28.068626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e8fc628e-60ff-4e51-a1b9-df75401fbb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:28.093615 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2aa21-9f2d-45c2-8d1c-f997f22e1d37 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:28.142410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:28.143335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.143804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.144481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.145303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] RBAC: Adding query filter params (name=member) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:28.145859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:28.147432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:28.158526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 138/278] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:28.164549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:28.164739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 141/279] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:28.220749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:28.279514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f72ffe-766c-4cce-9849-6e2d418e2853 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:28.316919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550c81c-2e3f-4d01-a7bc-56dea5ebb142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:28.317614 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c81c-2e3f-4d01-a7bc-56dea5ebb142 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.317894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c81c-2e3f-4d01-a7bc-56dea5ebb142 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.318161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c81c-2e3f-4d01-a7bc-56dea5ebb142 None admin] PATH_INFO: `/v3/users/ea42feff3f834573a06c6d41715183f9` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.333516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550c81c-2e3f-4d01-a7bc-56dea5ebb142 None admin] RBAC: Authorizing `identity:get_user(user_id=ea42feff3f834573a06c6d41715183f9)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:28.334967 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550c81c-2e3f-4d01-a7bc-56dea5ebb142 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:28.336725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 139/280] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:28 2022] GET /identity/v3/users/ea42feff3f834573a06c6d41715183f9 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:28.342796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc628e-60ff-4e51-a1b9-df75401fbb8f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:28.403395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:28.437636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550c81c-2e3f-4d01-a7bc-56dea5ebb142 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:28.468473 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc628e-60ff-4e51-a1b9-df75401fbb8f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:28.512664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:28.513679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.514176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.514698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.515749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] RBAC: Adding query filter params (role.id=4367ece899d646eeb2e2917530897f7f, user.id=ea42feff3f834573a06c6d41715183f9, scope.system=all) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:28.516580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:28.518266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:28.525065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 142/281] 10.222.0.55 () {56 vars in 1308 bytes} [Thu Sep 1 15:29:28 2022] GET /identity/v3/role_assignments?user.id=ea42feff3f834573a06c6d41715183f9&scope.system=all&role.id=4367ece899d646eeb2e2917530897f7f => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:28.559603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550c81c-2e3f-4d01-a7bc-56dea5ebb142 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:28.567814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:28.597171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2d3c2-28ac-42d0-922f-fb85eb850302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:28.597823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d3c2-28ac-42d0-922f-fb85eb850302 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.598104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d3c2-28ac-42d0-922f-fb85eb850302 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.598379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d3c2-28ac-42d0-922f-fb85eb850302 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.610711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2d3c2-28ac-42d0-922f-fb85eb850302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-bda2d3c2-28ac-42d0-922f-fb85eb850302 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:28.615816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:28.617300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:28.618507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 140/282] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:28.623902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:28.769921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9520e2-848b-4d27-a8c0-32883c6e882f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:28.787158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:28.816620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d831e14-7790-47ab-a3f8-558b4e5c7030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:28.817235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831e14-7790-47ab-a3f8-558b4e5c7030 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.817519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831e14-7790-47ab-a3f8-558b4e5c7030 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.817797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831e14-7790-47ab-a3f8-558b4e5c7030 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.818468 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d831e14-7790-47ab-a3f8-558b4e5c7030 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:28.818773 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d831e14-7790-47ab-a3f8-558b4e5c7030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:28.820227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d831e14-7790-47ab-a3f8-558b4e5c7030 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:28.831377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 143/283] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:28.837131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2d3c2-28ac-42d0-922f-fb85eb850302 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:28.940616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d4af-e551-40f5-9d1e-5c165cc970cf None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.940905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d4af-e551-40f5-9d1e-5c165cc970cf None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.941191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8d4af-e551-40f5-9d1e-5c165cc970cf None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:28.942541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 144/284] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:28.953171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76856-39dc-4177-bb85-01e7c8c69952 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:28.953458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76856-39dc-4177-bb85-01e7c8c69952 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:28.953739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed76856-39dc-4177-bb85-01e7c8c69952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.005664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2d3c2-28ac-42d0-922f-fb85eb850302 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.012843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-eed76856-39dc-4177-bb85-01e7c8c69952 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:29.014057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-eed76856-39dc-4177-bb85-01e7c8c69952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:29.043629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b684b4b-9a84-404d-ac88-f5fefea61f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.044340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b684b4b-9a84-404d-ac88-f5fefea61f62 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.044629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b684b4b-9a84-404d-ac88-f5fefea61f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.044905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b684b4b-9a84-404d-ac88-f5fefea61f62 None admin] PATH_INFO: `/v3/users/f0cc6f79c27d4ae1967a09aeb30be50b` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.046036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b684b4b-9a84-404d-ac88-f5fefea61f62 None admin] RBAC: Authorizing `identity:get_user(user_id=f0cc6f79c27d4ae1967a09aeb30be50b)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.047522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b684b4b-9a84-404d-ac88-f5fefea61f62 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.049548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 141/285] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:28 2022] GET /identity/v3/users/f0cc6f79c27d4ae1967a09aeb30be50b => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:29.056720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b684b4b-9a84-404d-ac88-f5fefea61f62 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.123627 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:29.164733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 145/286] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:29.225534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b684b4b-9a84-404d-ac88-f5fefea61f62 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.277684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda445a6-480e-4e08-a8ff-066921ed40ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.278654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda445a6-480e-4e08-a8ff-066921ed40ef None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.279136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda445a6-480e-4e08-a8ff-066921ed40ef None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.279608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda445a6-480e-4e08-a8ff-066921ed40ef None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.284457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda445a6-480e-4e08-a8ff-066921ed40ef None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.286145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda445a6-480e-4e08-a8ff-066921ed40ef None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.288385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 142/287] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:29 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:29.294830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed76856-39dc-4177-bb85-01e7c8c69952 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.425843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed76856-39dc-4177-bb85-01e7c8c69952 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.436863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:29.471291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac967098-38d6-4868-b5b6-71ea51b71b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.472362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967098-38d6-4868-b5b6-71ea51b71b4d None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.472850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967098-38d6-4868-b5b6-71ea51b71b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.473322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967098-38d6-4868-b5b6-71ea51b71b4d None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862/users/f0cc6f79c27d4ae1967a09aeb30be50b/roles/198c78d869d349aebc88462da8545286` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.475493 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac967098-38d6-4868-b5b6-71ea51b71b4d None admin] RBAC: Authorizing `identity:create_grant(project_id=84031b186a7b4222a649e89146434862, user_id=f0cc6f79c27d4ae1967a09aeb30be50b, role_id=198c78d869d349aebc88462da8545286)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.477732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac967098-38d6-4868-b5b6-71ea51b71b4d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.508825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 146/288] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:29:29 2022] PUT /identity/v3/projects/84031b186a7b4222a649e89146434862/users/f0cc6f79c27d4ae1967a09aeb30be50b/roles/198c78d869d349aebc88462da8545286 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:29.579668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda445a6-480e-4e08-a8ff-066921ed40ef None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.705353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda445a6-480e-4e08-a8ff-066921ed40ef None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.707025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:29.754457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc090d9-79c8-4a62-a658-a18c03a8a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.755099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc090d9-79c8-4a62-a658-a18c03a8a378 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.755378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc090d9-79c8-4a62-a658-a18c03a8a378 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.755652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc090d9-79c8-4a62-a658-a18c03a8a378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.769483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc090d9-79c8-4a62-a658-a18c03a8a378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-2cc090d9-79c8-4a62-a658-a18c03a8a378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:29.774984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:29.775935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:29.776725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 143/289] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:29.783516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac967098-38d6-4868-b5b6-71ea51b71b4d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:29.900570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac967098-38d6-4868-b5b6-71ea51b71b4d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:29.936419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:29.937031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:29.937314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:29.937651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:29.938320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:29.938670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:29.940092 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:29.953953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 147/290] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:29.955697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc090d9-79c8-4a62-a658-a18c03a8a378 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.102633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc090d9-79c8-4a62-a658-a18c03a8a378 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.153931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc830-22d5-4f32-bf50-91f500a3d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.154905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc830-22d5-4f32-bf50-91f500a3d56b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.155389 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc830-22d5-4f32-bf50-91f500a3d56b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.155897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cc830-22d5-4f32-bf50-91f500a3d56b None admin] PATH_INFO: `/v3/users/9bc66494910a4da6ad15bd1809f500d2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.157264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cc830-22d5-4f32-bf50-91f500a3d56b None admin] RBAC: Authorizing `identity:get_user(user_id=9bc66494910a4da6ad15bd1809f500d2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.158965 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cc830-22d5-4f32-bf50-91f500a3d56b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.160841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 144/291] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:29 2022] GET /identity/v3/users/9bc66494910a4da6ad15bd1809f500d2 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:30.166752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.220331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.297379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06835d0-f2aa-438d-b56f-3b6e0309d1b8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.344492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdcfb3-ce38-4d19-912f-04bf7a209dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.345167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcfb3-ce38-4d19-912f-04bf7a209dbc None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.345445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcfb3-ce38-4d19-912f-04bf7a209dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.345717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdcfb3-ce38-4d19-912f-04bf7a209dbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.432684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdcfb3-ce38-4d19-912f-04bf7a209dbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.434162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdcfb3-ce38-4d19-912f-04bf7a209dbc None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.482294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.575748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 148/292] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:29:30.581277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc830-22d5-4f32-bf50-91f500a3d56b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.634024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.731076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5acc6-0ee8-452c-baf0-c3c5fb52b6bb None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.731258 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5acc6-0ee8-452c-baf0-c3c5fb52b6bb None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.731538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5acc6-0ee8-452c-baf0-c3c5fb52b6bb None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.733221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 149/293] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:30.737959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae68d-4f80-46bc-b102-0e0006617970 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.738243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae68d-4f80-46bc-b102-0e0006617970 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.738515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae68d-4f80-46bc-b102-0e0006617970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.739398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cc830-22d5-4f32-bf50-91f500a3d56b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.757360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-a27ae68d-4f80-46bc-b102-0e0006617970 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:30.758530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-a27ae68d-4f80-46bc-b102-0e0006617970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:30.793952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909614c-939e-4a79-9434-7249d6944461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.794976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909614c-939e-4a79-9434-7249d6944461 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.795460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909614c-939e-4a79-9434-7249d6944461 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.795991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909614c-939e-4a79-9434-7249d6944461 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.800552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909614c-939e-4a79-9434-7249d6944461 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.802238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909614c-939e-4a79-9434-7249d6944461 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.804862 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 145/294] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:30 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:30.812359 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909614c-939e-4a79-9434-7249d6944461 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:30.854387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 150/295] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:30.915135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226739fc-e1d2-4742-b47b-222a2fbfe9c9 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.915444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226739fc-e1d2-4742-b47b-222a2fbfe9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.915637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226739fc-e1d2-4742-b47b-222a2fbfe9c9 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.918471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 151/296] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:30.922247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414929-549d-4776-8116-1dac3f90fb43 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.922535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414929-549d-4776-8116-1dac3f90fb43 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.922811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414929-549d-4776-8116-1dac3f90fb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.935196 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:30.939827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909614c-939e-4a79-9434-7249d6944461 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:30.959805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ee414929-549d-4776-8116-1dac3f90fb43 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:30.960003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ee414929-549d-4776-8116-1dac3f90fb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:30.984988 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1faec-3075-4a9d-8a5f-cef54bb564e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:30.985524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1faec-3075-4a9d-8a5f-cef54bb564e9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.985808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1faec-3075-4a9d-8a5f-cef54bb564e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.986086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1faec-3075-4a9d-8a5f-cef54bb564e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.986826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1faec-3075-4a9d-8a5f-cef54bb564e9 None admin] RBAC: Adding query filter params (role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=84031b186a7b4222a649e89146434862, user.id=9bc66494910a4da6ad15bd1809f500d2) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:30.987144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1faec-3075-4a9d-8a5f-cef54bb564e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:30.988632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1faec-3075-4a9d-8a5f-cef54bb564e9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:30.995345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 146/297] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:30 2022] GET /identity/v3/role_assignments?user.id=9bc66494910a4da6ad15bd1809f500d2&scope.project.id=84031b186a7b4222a649e89146434862&role.id=4367ece899d646eeb2e2917530897f7f => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:30.996608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141b39-43de-4180-b2cd-8e3e56e30be3 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:30.996958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141b39-43de-4180-b2cd-8e3e56e30be3 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:30.997242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09141b39-43de-4180-b2cd-8e3e56e30be3 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:30.998514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 147/298] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:31.004162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8930-ec80-44ba-a3a5-fa5e51f5379d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.004444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8930-ec80-44ba-a3a5-fa5e51f5379d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.004724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8930-ec80-44ba-a3a5-fa5e51f5379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.024268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:31.033022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-dc2f8930-ec80-44ba-a3a5-fa5e51f5379d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:31.034266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-dc2f8930-ec80-44ba-a3a5-fa5e51f5379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:31.035345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 152/299] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:31.162349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 148/300] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:31.214506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee414929-549d-4776-8116-1dac3f90fb43 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:31.317265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee414929-549d-4776-8116-1dac3f90fb43 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:31.317754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8930-ec80-44ba-a3a5-fa5e51f5379d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:31.360306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebf2c4-c546-486e-bb07-c8731a3458fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:31.360944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf2c4-c546-486e-bb07-c8731a3458fd None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.361221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf2c4-c546-486e-bb07-c8731a3458fd None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.361489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebf2c4-c546-486e-bb07-c8731a3458fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.362606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebf2c4-c546-486e-bb07-c8731a3458fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:31.364545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebf2c4-c546-486e-bb07-c8731a3458fd None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:31.365939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 153/301] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:31.373166 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebf2c4-c546-486e-bb07-c8731a3458fd None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:31.434077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:31.435287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:31.448110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8930-ec80-44ba-a3a5-fa5e51f5379d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:31.481858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebf2c4-c546-486e-bb07-c8731a3458fd None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:31.490746 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125fa9b-9939-4e59-8cbf-45d29d0fa162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:31.491705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125fa9b-9939-4e59-8cbf-45d29d0fa162 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.492272 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125fa9b-9939-4e59-8cbf-45d29d0fa162 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.492803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125fa9b-9939-4e59-8cbf-45d29d0fa162 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.504521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125fa9b-9939-4e59-8cbf-45d29d0fa162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-b125fa9b-9939-4e59-8cbf-45d29d0fa162 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:31.510782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:31.511685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:31.512508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:31.514717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 149/302] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:31.520778 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125fa9b-9939-4e59-8cbf-45d29d0fa162 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:31.526010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137c73-efe9-428e-9298-9ee61b3554da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:31.527004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137c73-efe9-428e-9298-9ee61b3554da None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.528478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137c73-efe9-428e-9298-9ee61b3554da None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.528758 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137c73-efe9-428e-9298-9ee61b3554da None admin] PATH_INFO: `/v3/groups` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.529432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0137c73-efe9-428e-9298-9ee61b3554da None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:31.530894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0137c73-efe9-428e-9298-9ee61b3554da None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:31.547212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 154/303] 10.222.0.55 () {60 vars in 1134 bytes} [Thu Sep 1 15:29:31 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:29:31.548365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137c73-efe9-428e-9298-9ee61b3554da None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:31.649148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125fa9b-9939-4e59-8cbf-45d29d0fa162 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:31.671826 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137c73-efe9-428e-9298-9ee61b3554da None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:31.688865 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:31.689711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.690018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.690355 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.691264 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:31.692821 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:31.693206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:31.695620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:31.705945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 150/304] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:31.711907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:31.712314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6952274-9198-440c-ad32-1002b57f17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:31.713156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6952274-9198-440c-ad32-1002b57f17f3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.713617 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6952274-9198-440c-ad32-1002b57f17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.714067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6952274-9198-440c-ad32-1002b57f17f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.731669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6952274-9198-440c-ad32-1002b57f17f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:31.734422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b6952274-9198-440c-ad32-1002b57f17f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:31.737384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:31.738284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:31.739065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 155/305] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:31.746364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6952274-9198-440c-ad32-1002b57f17f3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:31.837283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a842a17-1a7a-42d7-aca1-6036d62df21f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:31.874989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464b225-9e65-4dc3-88bf-634bf38e930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:31.875638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b225-9e65-4dc3-88bf-634bf38e930d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.875961 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b225-9e65-4dc3-88bf-634bf38e930d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.876239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b225-9e65-4dc3-88bf-634bf38e930d None admin] PATH_INFO: `/v3/users/9f11204fe5e1495dbf2bb017038239d9` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.888120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6952274-9198-440c-ad32-1002b57f17f3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:31.890320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464b225-9e65-4dc3-88bf-634bf38e930d None admin] RBAC: Authorizing `identity:get_user(user_id=9f11204fe5e1495dbf2bb017038239d9)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:31.891954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464b225-9e65-4dc3-88bf-634bf38e930d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:31.893764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 151/306] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:31 2022] GET /identity/v3/users/9f11204fe5e1495dbf2bb017038239d9 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:31.894915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41179bb3-c4e1-41b4-ba70-54098a8d925d None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.895552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41179bb3-c4e1-41b4-ba70-54098a8d925d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.895552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41179bb3-c4e1-41b4-ba70-54098a8d925d None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.896809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 152/307] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:31.900089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41179bb3-c4e1-41b4-ba70-54098a8d925d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:31.935815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51355ba-976d-4664-8b05-fcf505228dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:31.936436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51355ba-976d-4664-8b05-fcf505228dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.936740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51355ba-976d-4664-8b05-fcf505228dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.937003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51355ba-976d-4664-8b05-fcf505228dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.937650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51355ba-976d-4664-8b05-fcf505228dc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:31.937952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51355ba-976d-4664-8b05-fcf505228dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:31.939333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51355ba-976d-4664-8b05-fcf505228dc2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:31.947460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 156/308] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:31.953133 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d6a28-7afc-491b-83df-e82cd5f07664 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:31.953417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d6a28-7afc-491b-83df-e82cd5f07664 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:31.953687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d6a28-7afc-491b-83df-e82cd5f07664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:31.972586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-592d6a28-7afc-491b-83df-e82cd5f07664 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:31.973777 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-592d6a28-7afc-491b-83df-e82cd5f07664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:31.996919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:32.018927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:32.032392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41179bb3-c4e1-41b4-ba70-54098a8d925d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:32.053396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 157/309] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:32.054286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d6a28-7afc-491b-83df-e82cd5f07664 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:32.078045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:32.078657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.078935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.079203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.079962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] RBAC: Adding query filter params (role.id=198c78d869d349aebc88462da8545286, user.id=9f11204fe5e1495dbf2bb017038239d9, scope.system=all) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:32.080266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:32.081709 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:32.095883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 153/310] 10.222.0.55 () {56 vars in 1308 bytes} [Thu Sep 1 15:29:31 2022] GET /identity/v3/role_assignments?user.id=9f11204fe5e1495dbf2bb017038239d9&scope.system=all&role.id=198c78d869d349aebc88462da8545286 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:32.176059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d6a28-7afc-491b-83df-e82cd5f07664 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:32.214976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe49e2-0b1c-4206-839d-f15f6f021941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:32.215628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe49e2-0b1c-4206-839d-f15f6f021941 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.215948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe49e2-0b1c-4206-839d-f15f6f021941 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.216226 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe49e2-0b1c-4206-839d-f15f6f021941 None admin] PATH_INFO: `/v3/users/ea42feff3f834573a06c6d41715183f9` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.217414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe49e2-0b1c-4206-839d-f15f6f021941 None admin] RBAC: Authorizing `identity:get_user(user_id=ea42feff3f834573a06c6d41715183f9)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:32.218887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe49e2-0b1c-4206-839d-f15f6f021941 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:32.220872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 158/311] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:32 2022] GET /identity/v3/users/ea42feff3f834573a06c6d41715183f9 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:32.226279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:32.334516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13666f99-4ca0-4967-8ef7-a95eecd2c4c0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:32.339440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe49e2-0b1c-4206-839d-f15f6f021941 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:32.371439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844ba8-7ec9-49d1-af50-0bd0ac974f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:32.372469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844ba8-7ec9-49d1-af50-0bd0ac974f63 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.372956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844ba8-7ec9-49d1-af50-0bd0ac974f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.373460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844ba8-7ec9-49d1-af50-0bd0ac974f63 None admin] PATH_INFO: `/v3/system/users/ea42feff3f834573a06c6d41715183f9/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.375110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c844ba8-7ec9-49d1-af50-0bd0ac974f63 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea42feff3f834573a06c6d41715183f9, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:32.376743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c844ba8-7ec9-49d1-af50-0bd0ac974f63 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:32.380790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:32.385310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:32.396164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 154/312] 10.222.0.55 () {58 vars in 1334 bytes} [Thu Sep 1 15:29:32 2022] PUT /identity/v3/system/users/ea42feff3f834573a06c6d41715183f9/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:32.458828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe49e2-0b1c-4206-839d-f15f6f021941 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:32.497022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05227f9-b28e-4452-95cf-8d78afabd8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:32.497672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05227f9-b28e-4452-95cf-8d78afabd8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.497953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05227f9-b28e-4452-95cf-8d78afabd8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.498228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05227f9-b28e-4452-95cf-8d78afabd8b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.511013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05227f9-b28e-4452-95cf-8d78afabd8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-d05227f9-b28e-4452-95cf-8d78afabd8b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:32.516068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:32.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:32.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 159/313] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:32.524287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844ba8-7ec9-49d1-af50-0bd0ac974f63 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:32.638795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844ba8-7ec9-49d1-af50-0bd0ac974f63 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:32.674449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:32.675066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.675326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.675595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.676287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:32.676590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:32.677954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:32.687340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 155/314] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:32.693099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05227f9-b28e-4452-95cf-8d78afabd8b5 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:32.799230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:32.803125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05227f9-b28e-4452-95cf-8d78afabd8b5 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:32.838835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d96f3a-cba4-4877-95a7-534705d07c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:32.839472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d96f3a-cba4-4877-95a7-534705d07c3d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:32.839754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d96f3a-cba4-4877-95a7-534705d07c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:32.840057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d96f3a-cba4-4877-95a7-534705d07c3d None admin] PATH_INFO: `/v3/users/f0cc6f79c27d4ae1967a09aeb30be50b` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:32.841196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d96f3a-cba4-4877-95a7-534705d07c3d None admin] RBAC: Authorizing `identity:get_user(user_id=f0cc6f79c27d4ae1967a09aeb30be50b)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:32.842672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d96f3a-cba4-4877-95a7-534705d07c3d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:32.844655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 160/315] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:32 2022] GET /identity/v3/users/f0cc6f79c27d4ae1967a09aeb30be50b => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:32.850353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:32.915390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:32.964892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec443a0-e3ce-4514-8a3c-ef1f351e54ed None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.004052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dec19-cc8b-4c89-a131-af74c2307120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.004677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dec19-cc8b-4c89-a131-af74c2307120 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.005118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dec19-cc8b-4c89-a131-af74c2307120 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.005404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dec19-cc8b-4c89-a131-af74c2307120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.075955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dec19-cc8b-4c89-a131-af74c2307120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.077426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dec19-cc8b-4c89-a131-af74c2307120 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.140016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:33.181956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 156/316] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:33.189079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d96f3a-cba4-4877-95a7-534705d07c3d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.295337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d96f3a-cba4-4877-95a7-534705d07c3d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.330976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40bdbb-d29d-43b4-af1d-385bd0def3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.331988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40bdbb-d29d-43b4-af1d-385bd0def3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.332472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40bdbb-d29d-43b4-af1d-385bd0def3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.332965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40bdbb-d29d-43b4-af1d-385bd0def3f2 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.334308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40bdbb-d29d-43b4-af1d-385bd0def3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.336083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40bdbb-d29d-43b4-af1d-385bd0def3f2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.338210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 161/317] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:33 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:33.344223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dec19-cc8b-4c89-a131-af74c2307120 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.453158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dec19-cc8b-4c89-a131-af74c2307120 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:33.489663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09fc1d-f82d-4036-a874-5143eb063275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:33.490276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09fc1d-f82d-4036-a874-5143eb063275 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.490558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09fc1d-f82d-4036-a874-5143eb063275 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.490836 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09fc1d-f82d-4036-a874-5143eb063275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.492132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09fc1d-f82d-4036-a874-5143eb063275 None admin] RBAC: Adding query filter params (role.id=198c78d869d349aebc88462da8545286, scope.project.id=84031b186a7b4222a649e89146434862, user.id=f0cc6f79c27d4ae1967a09aeb30be50b) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:33.492449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09fc1d-f82d-4036-a874-5143eb063275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:33.493899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09fc1d-f82d-4036-a874-5143eb063275 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:33.500364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 157/318] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:29:33 2022] GET /identity/v3/role_assignments?user.id=f0cc6f79c27d4ae1967a09aeb30be50b&scope.project.id=84031b186a7b4222a649e89146434862&role.id=198c78d869d349aebc88462da8545286 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:33.563537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadcb1-becf-4181-a459-e6d9259bbc37 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.564105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadcb1-becf-4181-a459-e6d9259bbc37 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.564105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caadcb1-becf-4181-a459-e6d9259bbc37 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.565715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 162/319] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:33.571882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6019be-ad86-4399-bd09-62064471e1c3 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:33.572165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6019be-ad86-4399-bd09-62064471e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:33.572447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6019be-ad86-4399-bd09-62064471e1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:33.592528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-6e6019be-ad86-4399-bd09-62064471e1c3 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:33.593680 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6e6019be-ad86-4399-bd09-62064471e1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:33.618062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:33.670772 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 158/320] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:33.939409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caadcb1-becf-4181-a459-e6d9259bbc37 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:33.979552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:34.049798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caadcb1-becf-4181-a459-e6d9259bbc37 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:34.081817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23de461-7813-4135-9754-12209d33c9e6 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.082324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23de461-7813-4135-9754-12209d33c9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.082445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23de461-7813-4135-9754-12209d33c9e6 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.083850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 159/321] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:34.084679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe3c85-3d3c-4203-911d-bfab9eb4d7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:34.085872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3c85-3d3c-4203-911d-bfab9eb4d7de None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.086155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3c85-3d3c-4203-911d-bfab9eb4d7de None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.086424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3c85-3d3c-4203-911d-bfab9eb4d7de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.087524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe3c85-3d3c-4203-911d-bfab9eb4d7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:34.089003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe3c85-3d3c-4203-911d-bfab9eb4d7de None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:34.089165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82e7d-df06-4766-961c-d3356350c109 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.089414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82e7d-df06-4766-961c-d3356350c109 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.089691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82e7d-df06-4766-961c-d3356350c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.091812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 163/322] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:34.095796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe3c85-3d3c-4203-911d-bfab9eb4d7de None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:34.108180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3fe82e7d-df06-4766-961c-d3356350c109 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:34.109355 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3fe82e7d-df06-4766-961c-d3356350c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:34.182323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 160/323] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:34.206816 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe3c85-3d3c-4203-911d-bfab9eb4d7de None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:34.208494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:34.243290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376a364-80f2-4380-8ee7-b5411fc25460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:34.243933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a364-80f2-4380-8ee7-b5411fc25460 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.244212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a364-80f2-4380-8ee7-b5411fc25460 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.244479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376a364-80f2-4380-8ee7-b5411fc25460 None admin] PATH_INFO: `/v3/groups` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.245100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376a364-80f2-4380-8ee7-b5411fc25460 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:34.246524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376a364-80f2-4380-8ee7-b5411fc25460 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:34.262360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 164/324] 10.222.0.55 () {60 vars in 1134 bytes} [Thu Sep 1 15:29:34 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:29:34.373594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cf038-ca8b-4a0d-8fdc-daaa62e398d0 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.373949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cf038-ca8b-4a0d-8fdc-daaa62e398d0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.374173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cf038-ca8b-4a0d-8fdc-daaa62e398d0 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.375699 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 161/325] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:34.381030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bffbd-a5d8-4fc3-8ecd-81363beaccea None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.381319 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bffbd-a5d8-4fc3-8ecd-81363beaccea None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.381592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bffbd-a5d8-4fc3-8ecd-81363beaccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.400551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-2b8bffbd-a5d8-4fc3-8ecd-81363beaccea None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:34.401722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2b8bffbd-a5d8-4fc3-8ecd-81363beaccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:34.453690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cf038-ca8b-4a0d-8fdc-daaa62e398d0 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:34.472539 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 165/326] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:34.554669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:34.575183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cf038-ca8b-4a0d-8fdc-daaa62e398d0 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:34.612032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4d118-2a77-4d01-a179-621ceed3dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:34.612668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d118-2a77-4d01-a179-621ceed3dff4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.612943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d118-2a77-4d01-a179-621ceed3dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.613232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d118-2a77-4d01-a179-621ceed3dff4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.623888 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4d118-2a77-4d01-a179-621ceed3dff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-17d4d118-2a77-4d01-a179-621ceed3dff4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:34.628721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:34.629636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:34.630440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 162/327] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:34.637528 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bffbd-a5d8-4fc3-8ecd-81363beaccea None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:34.735162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:34.746502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4d118-2a77-4d01-a179-621ceed3dff4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:34.746673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bffbd-a5d8-4fc3-8ecd-81363beaccea None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:34.799216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:34.799903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.800196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.800470 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.801150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:34.801456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:34.802866 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:34.815467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 166/328] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:34.822479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:34.890990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4d118-2a77-4d01-a179-621ceed3dff4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:34.931642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72f0ac-d544-434a-8c21-365d708b8209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:34.932238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f0ac-d544-434a-8c21-365d708b8209 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.932521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f0ac-d544-434a-8c21-365d708b8209 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.932792 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72f0ac-d544-434a-8c21-365d708b8209 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:34.945944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72f0ac-d544-434a-8c21-365d708b8209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:34.958874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e9d92-21b5-4b60-a508-5cc62bc43fb1 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-9d72f0ac-d544-434a-8c21-365d708b8209 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:34.964034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:34.964910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:34.965701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:34.968530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 163/329] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:34.974082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72f0ac-d544-434a-8c21-365d708b8209 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:34.992403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:34.997178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a05f00-0bcb-4211-a224-7fb7c130e24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:34.997950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a05f00-0bcb-4211-a224-7fb7c130e24d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:34.998335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a05f00-0bcb-4211-a224-7fb7c130e24d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:34.998719 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a05f00-0bcb-4211-a224-7fb7c130e24d None admin] PATH_INFO: `/v3/users/9f11204fe5e1495dbf2bb017038239d9` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:35.000368 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a05f00-0bcb-4211-a224-7fb7c130e24d None admin] RBAC: Authorizing `identity:get_user(user_id=9f11204fe5e1495dbf2bb017038239d9)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:35.002010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a05f00-0bcb-4211-a224-7fb7c130e24d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:35.011987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 167/330] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:34 2022] GET /identity/v3/users/9f11204fe5e1495dbf2bb017038239d9 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:35.013933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a05f00-0bcb-4211-a224-7fb7c130e24d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:35.044982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:35.090171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72f0ac-d544-434a-8c21-365d708b8209 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:35.127846 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:35.128461 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:35.128742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:35.129011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:35.129714 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:35.129973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:35.131336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:35.133799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a05f00-0bcb-4211-a224-7fb7c130e24d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:35.141588 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 164/331] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:35.146929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:35.172598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540065d1-62ad-4ec4-a209-6020c44e44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:35.173864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540065d1-62ad-4ec4-a209-6020c44e44e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:35.174349 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540065d1-62ad-4ec4-a209-6020c44e44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:35.174859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540065d1-62ad-4ec4-a209-6020c44e44e9 None admin] PATH_INFO: `/v3/system/users/9f11204fe5e1495dbf2bb017038239d9/roles/198c78d869d349aebc88462da8545286` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:35.176707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540065d1-62ad-4ec4-a209-6020c44e44e9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f11204fe5e1495dbf2bb017038239d9, role_id=198c78d869d349aebc88462da8545286)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:35.178300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540065d1-62ad-4ec4-a209-6020c44e44e9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:35.189474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 168/332] 10.222.0.55 () {58 vars in 1334 bytes} [Thu Sep 1 15:29:35 2022] PUT /identity/v3/system/users/9f11204fe5e1495dbf2bb017038239d9/roles/198c78d869d349aebc88462da8545286 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:29:35.219976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:35.260440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319cd3-f7e1-4513-aeeb-61babd4946aa None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:35.297968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffcea2-26bf-44aa-b3bf-94cd41e0af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:35.298598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcea2-26bf-44aa-b3bf-94cd41e0af84 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:35.298870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcea2-26bf-44aa-b3bf-94cd41e0af84 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:35.299201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcea2-26bf-44aa-b3bf-94cd41e0af84 None admin] PATH_INFO: `/v3/users/ea42feff3f834573a06c6d41715183f9` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:35.300384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffcea2-26bf-44aa-b3bf-94cd41e0af84 None admin] RBAC: Authorizing `identity:get_user(user_id=ea42feff3f834573a06c6d41715183f9)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:35.301829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffcea2-26bf-44aa-b3bf-94cd41e0af84 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:35.303866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 165/333] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:35 2022] GET /identity/v3/users/ea42feff3f834573a06c6d41715183f9 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:35.310134 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540065d1-62ad-4ec4-a209-6020c44e44e9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:35.409843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:35.432212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540065d1-62ad-4ec4-a209-6020c44e44e9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:35.473280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe37af-82ea-48bb-b9c8-4592b5a1f461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:35.473905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe37af-82ea-48bb-b9c8-4592b5a1f461 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:35.474186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe37af-82ea-48bb-b9c8-4592b5a1f461 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:35.474463 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe37af-82ea-48bb-b9c8-4592b5a1f461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:35.475200 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe37af-82ea-48bb-b9c8-4592b5a1f461 None admin] RBAC: Adding query filter params (role.id=4367ece899d646eeb2e2917530897f7f, user.id=ea42feff3f834573a06c6d41715183f9, scope.system=all) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:35.476662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe37af-82ea-48bb-b9c8-4592b5a1f461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:35.478124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe37af-82ea-48bb-b9c8-4592b5a1f461 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:35.490527 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 169/334] 10.222.0.55 () {56 vars in 1308 bytes} [Thu Sep 1 15:29:35 2022] GET /identity/v3/role_assignments?user.id=ea42feff3f834573a06c6d41715183f9&scope.system=all&role.id=4367ece899d646eeb2e2917530897f7f => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:36.493760 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13453-d3f3-420a-80f9-1fb2271e7cf0 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:36.494271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13453-d3f3-420a-80f9-1fb2271e7cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:36.494271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13453-d3f3-420a-80f9-1fb2271e7cf0 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:36.496073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 166/335] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:36.501832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576df3bf-1af6-45dd-bd2a-4ce269545884 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:36.502376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576df3bf-1af6-45dd-bd2a-4ce269545884 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:36.502376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576df3bf-1af6-45dd-bd2a-4ce269545884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:36.528818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-576df3bf-1af6-45dd-bd2a-4ce269545884 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:36.530100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-576df3bf-1af6-45dd-bd2a-4ce269545884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:36.605527 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 170/336] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:37.068104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3fba1-0a61-4e7f-af6c-ed9a09f7a14c None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.068487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3fba1-0a61-4e7f-af6c-ed9a09f7a14c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.068707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3fba1-0a61-4e7f-af6c-ed9a09f7a14c None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.070228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 167/337] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:37.075646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608d87-d16b-4eb0-9ff8-5e83fd482fb0 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.076199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608d87-d16b-4eb0-9ff8-5e83fd482fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.076675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608d87-d16b-4eb0-9ff8-5e83fd482fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.096061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-10608d87-d16b-4eb0-9ff8-5e83fd482fb0 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:37.097701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-10608d87-d16b-4eb0-9ff8-5e83fd482fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:37.167725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3fba1-0a61-4e7f-af6c-ed9a09f7a14c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:37.184299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 171/338] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:37.353845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3fba1-0a61-4e7f-af6c-ed9a09f7a14c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:37.397528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1ab81-dc41-4eab-b47c-22dbc29b5b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:37.398718 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ab81-dc41-4eab-b47c-22dbc29b5b85 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.398999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ab81-dc41-4eab-b47c-22dbc29b5b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.399273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ab81-dc41-4eab-b47c-22dbc29b5b85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.406128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:37.416658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1ab81-dc41-4eab-b47c-22dbc29b5b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-81e1ab81-dc41-4eab-b47c-22dbc29b5b85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:37.421991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:37.422882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:37.423679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 168/339] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:37.428872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10608d87-d16b-4eb0-9ff8-5e83fd482fb0 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:37.437180 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:37.580051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10608d87-d16b-4eb0-9ff8-5e83fd482fb0 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:37.615051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:37.615592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.615896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.616171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.616891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:37.617231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:37.618623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:37.623420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90475e-443b-41a0-86d0-05b0d965dc42 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.623905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90475e-443b-41a0-86d0-05b0d965dc42 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.623993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90475e-443b-41a0-86d0-05b0d965dc42 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.625557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 169/340] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:37.629079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 172/341] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:37.630703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540079-3fd0-46ba-9516-4253fe1c5828 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.630990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540079-3fd0-46ba-9516-4253fe1c5828 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.631263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8540079-3fd0-46ba-9516-4253fe1c5828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.635531 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:37.676322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-e8540079-3fd0-46ba-9516-4253fe1c5828 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:37.677513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-e8540079-3fd0-46ba-9516-4253fe1c5828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:37.736850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:37.781646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f1bf5-b1d5-46f8-8bac-ca11088e01bd None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:37.791583 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 170/342] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 15:29:37.793103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540079-3fd0-46ba-9516-4253fe1c5828 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:37.820837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44fccc-b1eb-42fd-afbf-10bb9fa457e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:37.821461 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44fccc-b1eb-42fd-afbf-10bb9fa457e4 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.821744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44fccc-b1eb-42fd-afbf-10bb9fa457e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.822022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44fccc-b1eb-42fd-afbf-10bb9fa457e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.921539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8540079-3fd0-46ba-9516-4253fe1c5828 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:37.932591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44fccc-b1eb-42fd-afbf-10bb9fa457e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:37.934080 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44fccc-b1eb-42fd-afbf-10bb9fa457e4 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:37.952973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:37.962617 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32903a5-6707-4da8-80bc-e65a9fd7f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:37.963570 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32903a5-6707-4da8-80bc-e65a9fd7f352 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.964664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32903a5-6707-4da8-80bc-e65a9fd7f352 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.965186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32903a5-6707-4da8-80bc-e65a9fd7f352 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.977716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32903a5-6707-4da8-80bc-e65a9fd7f352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d32903a5-6707-4da8-80bc-e65a9fd7f352 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:37.983950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:37.984810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:37.985592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:37.987847 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 171/343] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:37.989960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904cda0-366e-4bea-b41c-3d7b3302b81d None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:37.990448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904cda0-366e-4bea-b41c-3d7b3302b81d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:37.991046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904cda0-366e-4bea-b41c-3d7b3302b81d None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:37.993800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 172/344] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:37.998505 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904cda0-366e-4bea-b41c-3d7b3302b81d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:38.108021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:38.118496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904cda0-366e-4bea-b41c-3d7b3302b81d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:38.160198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4d7cd-833a-41d6-90ee-c6f5d17c0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:38.161593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d7cd-833a-41d6-90ee-c6f5d17c0031 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.162085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d7cd-833a-41d6-90ee-c6f5d17c0031 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.162554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4d7cd-833a-41d6-90ee-c6f5d17c0031 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.163606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d7cd-833a-41d6-90ee-c6f5d17c0031 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:38.164214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d7cd-833a-41d6-90ee-c6f5d17c0031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:38.165839 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4d7cd-833a-41d6-90ee-c6f5d17c0031 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:38.175870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 173/345] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:38.177519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311819-831a-4459-9f34-2183abba2c05 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.178005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311819-831a-4459-9f34-2183abba2c05 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.178843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311819-831a-4459-9f34-2183abba2c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.192160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 173/346] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:38.193056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44fccc-b1eb-42fd-afbf-10bb9fa457e4 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:38.200875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-36311819-831a-4459-9f34-2183abba2c05 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:38.202361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-36311819-831a-4459-9f34-2183abba2c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:38.272169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:38.280539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 174/347] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:38.282216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36311819-831a-4459-9f34-2183abba2c05 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:38.402581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36311819-831a-4459-9f34-2183abba2c05 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:38.417865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44fccc-b1eb-42fd-afbf-10bb9fa457e4 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:38.444452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7e18-76be-41ed-aa2b-0c44915fce42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:38.445742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7e18-76be-41ed-aa2b-0c44915fce42 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.446299 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7e18-76be-41ed-aa2b-0c44915fce42 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.446779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb7e18-76be-41ed-aa2b-0c44915fce42 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.448262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7e18-76be-41ed-aa2b-0c44915fce42 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:38.450507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb7e18-76be-41ed-aa2b-0c44915fce42 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:38.452451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 175/348] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:38 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:38.453730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7e18-76be-41ed-aa2b-0c44915fce42 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:38.520246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:38.536504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927200d-bb86-4e4a-b00c-5366f4e4889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:38.537561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927200d-bb86-4e4a-b00c-5366f4e4889e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.537561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927200d-bb86-4e4a-b00c-5366f4e4889e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.537836 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927200d-bb86-4e4a-b00c-5366f4e4889e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.566868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb7e18-76be-41ed-aa2b-0c44915fce42 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:38.609824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2b848-0ed6-4348-bdfa-1456f9e075a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:38.611094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:38.612089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b848-0ed6-4348-bdfa-1456f9e075a8 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.612633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b848-0ed6-4348-bdfa-1456f9e075a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.613110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b848-0ed6-4348-bdfa-1456f9e075a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.626852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2b848-0ed6-4348-bdfa-1456f9e075a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-a4e2b848-0ed6-4348-bdfa-1456f9e075a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:38.633271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:38.634195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 15:29:38.635069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:38.637754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 176/349] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:38.638875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2b848-0ed6-4348-bdfa-1456f9e075a8 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:38.652731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927200d-bb86-4e4a-b00c-5366f4e4889e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:38.654432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927200d-bb86-4e4a-b00c-5366f4e4889e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:38.759325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2b848-0ed6-4348-bdfa-1456f9e075a8 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:38.767031 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:38.782518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 174/350] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:38.783582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927200d-bb86-4e4a-b00c-5366f4e4889e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:38.803809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0247a08-a658-4884-b576-ae6cec17be20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:38.804735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247a08-a658-4884-b576-ae6cec17be20 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.805157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247a08-a658-4884-b576-ae6cec17be20 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.805571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247a08-a658-4884-b576-ae6cec17be20 None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.813468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0247a08-a658-4884-b576-ae6cec17be20 None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:38.815584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0247a08-a658-4884-b576-ae6cec17be20 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:38.818355 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 177/351] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:38 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:38.819930 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0247a08-a658-4884-b576-ae6cec17be20 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:38.867986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:38.915992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927200d-bb86-4e4a-b00c-5366f4e4889e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:38.950130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0247a08-a658-4884-b576-ae6cec17be20 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:38.967641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51306abe-284a-44c8-aafd-85d98a2239a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:38.968383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306abe-284a-44c8-aafd-85d98a2239a7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.968669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306abe-284a-44c8-aafd-85d98a2239a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.968940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306abe-284a-44c8-aafd-85d98a2239a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.984685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51306abe-284a-44c8-aafd-85d98a2239a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-51306abe-284a-44c8-aafd-85d98a2239a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:38.990161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:38.991167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:38.992191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:38.993590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:38.994281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.994632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.994764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.994889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 175/352] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:38.995445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:38.995752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:38.997245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09967495-fec0-4520-8a63-cd7e27327627 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:38.997677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09967495-fec0-4520-8a63-cd7e27327627 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:38.998097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09967495-fec0-4520-8a63-cd7e27327627 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:38.999491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 176/353] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:39.000362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09967495-fec0-4520-8a63-cd7e27327627 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.001329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.013903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 178/354] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:39.014917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.052566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:39.129702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09967495-fec0-4520-8a63-cd7e27327627 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:39.144216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f3ab2-43d0-4de1-a6e6-d5517d0336d4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:39.164240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:39.172988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8ef2-49df-45ec-b08c-b9f98afe3903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:39.173834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8ef2-49df-45ec-b08c-b9f98afe3903 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.174255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8ef2-49df-45ec-b08c-b9f98afe3903 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.174669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8ef2-49df-45ec-b08c-b9f98afe3903 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.176042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8ef2-49df-45ec-b08c-b9f98afe3903 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:39.177652 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8ef2-49df-45ec-b08c-b9f98afe3903 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.179508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 177/355] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:38 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:39.180865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70149e-5c66-4849-b0a8-3d499b86159f None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.181331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70149e-5c66-4849-b0a8-3d499b86159f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.181797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70149e-5c66-4849-b0a8-3d499b86159f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.191818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:39.192553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.192902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.193270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.194085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] RBAC: Adding query filter params (group.id=c4ef7987b30e441a9996a65ab2edd4e8, role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=331fd9a5519d4bd0a191559b4f25947e) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:39.194467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:39.197342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.202866 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-8c70149e-5c66-4849-b0a8-3d499b86159f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:39.203805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 179/356] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/role_assignments?group.id=c4ef7987b30e441a9996a65ab2edd4e8&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=4367ece899d646eeb2e2917530897f7f => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:39.204102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8c70149e-5c66-4849-b0a8-3d499b86159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:39.204745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.290160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 178/357] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:39.291394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70149e-5c66-4849-b0a8-3d499b86159f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.315388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:39.323917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a21b4f-f3c8-4de3-8daf-12d517c61d60 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:39.363021 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:39.363823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.364124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.364469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.365218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:39.365590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:39.367685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.377794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 180/358] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:39.378176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.413082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70149e-5c66-4849-b0a8-3d499b86159f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:39.440374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:39.453761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa2948-fb9b-4e5d-b2ef-90632f34aded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:39.454776 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2948-fb9b-4e5d-b2ef-90632f34aded None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.455269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2948-fb9b-4e5d-b2ef-90632f34aded None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.455739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2948-fb9b-4e5d-b2ef-90632f34aded None admin] PATH_INFO: `/v3/users/9f11204fe5e1495dbf2bb017038239d9` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.457171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa2948-fb9b-4e5d-b2ef-90632f34aded None admin] RBAC: Authorizing `identity:get_user(user_id=9f11204fe5e1495dbf2bb017038239d9)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:39.459001 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa2948-fb9b-4e5d-b2ef-90632f34aded None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.461361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 179/359] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/users/9f11204fe5e1495dbf2bb017038239d9 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:39.462513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa2948-fb9b-4e5d-b2ef-90632f34aded None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.487900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295a2aa-789e-4d41-aaf1-9ccb39f565fe None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:39.525186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b3dd-c445-471d-a381-cc7d78f657da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:39.525830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b3dd-c445-471d-a381-cc7d78f657da None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.526120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b3dd-c445-471d-a381-cc7d78f657da None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.526381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b3dd-c445-471d-a381-cc7d78f657da None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.527489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60b3dd-c445-471d-a381-cc7d78f657da None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:39.528964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60b3dd-c445-471d-a381-cc7d78f657da None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.530623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 181/360] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:39.531464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b3dd-c445-471d-a381-cc7d78f657da None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.572525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:39.589665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa2948-fb9b-4e5d-b2ef-90632f34aded None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:39.631448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6545d-88c5-4f55-b766-a13dfdfdbd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:39.633190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6545d-88c5-4f55-b766-a13dfdfdbd7a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.633190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6545d-88c5-4f55-b766-a13dfdfdbd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.633319 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6545d-88c5-4f55-b766-a13dfdfdbd7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.664826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b3dd-c445-471d-a381-cc7d78f657da None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:39.707599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:39.708507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6265f7b-025b-493e-b9ae-ea65425d0c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:39.709013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265f7b-025b-493e-b9ae-ea65425d0c4f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.709310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265f7b-025b-493e-b9ae-ea65425d0c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.709553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265f7b-025b-493e-b9ae-ea65425d0c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.710321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6265f7b-025b-493e-b9ae-ea65425d0c4f None admin] RBAC: Adding query filter params (role.id=198c78d869d349aebc88462da8545286, user.id=9f11204fe5e1495dbf2bb017038239d9, scope.system=all) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:39.710635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6265f7b-025b-493e-b9ae-ea65425d0c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:39.712730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6265f7b-025b-493e-b9ae-ea65425d0c4f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.721803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6545d-88c5-4f55-b766-a13dfdfdbd7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:39.723676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6545d-88c5-4f55-b766-a13dfdfdbd7a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.733603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 182/361] 10.222.0.55 () {56 vars in 1308 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/role_assignments?user.id=9f11204fe5e1495dbf2bb017038239d9&scope.system=all&role.id=198c78d869d349aebc88462da8545286 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:39.736183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655ef9a-4920-421a-b48d-0a2f400f48fd None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.736968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655ef9a-4920-421a-b48d-0a2f400f48fd None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.737458 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655ef9a-4920-421a-b48d-0a2f400f48fd None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.740127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 183/362] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:39.742310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655ef9a-4920-421a-b48d-0a2f400f48fd None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.865727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:39.867511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 180/363] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:39.868526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6545d-88c5-4f55-b766-a13dfdfdbd7a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:39.881751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655ef9a-4920-421a-b48d-0a2f400f48fd None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:39.930431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3d08f-27ce-4818-bc3e-e90c2acb2663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:39.931683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3d08f-27ce-4818-bc3e-e90c2acb2663 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.932128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3d08f-27ce-4818-bc3e-e90c2acb2663 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.932542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3d08f-27ce-4818-bc3e-e90c2acb2663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.933421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3d08f-27ce-4818-bc3e-e90c2acb2663 None admin] RBAC: Adding query filter params (group.id=c4ef7987b30e441a9996a65ab2edd4e8, role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=331fd9a5519d4bd0a191559b4f25947e) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:39.934278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3d08f-27ce-4818-bc3e-e90c2acb2663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:39.936297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3d08f-27ce-4818-bc3e-e90c2acb2663 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:39.944231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 184/364] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/role_assignments?group.id=c4ef7987b30e441a9996a65ab2edd4e8&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:39.946469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d43b-0711-46c5-aa39-8444249788d4 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:39.946910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d43b-0711-46c5-aa39-8444249788d4 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:39.947376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9d43b-0711-46c5-aa39-8444249788d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:39.982513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-b3d9d43b-0711-46c5-aa39-8444249788d4 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:39.982881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b3d9d43b-0711-46c5-aa39-8444249788d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:39.987312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.002232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6545d-88c5-4f55-b766-a13dfdfdbd7a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.054853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aace2-3485-4e12-bf0d-e3c88ae45a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.055503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aace2-3485-4e12-bf0d-e3c88ae45a40 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.055858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aace2-3485-4e12-bf0d-e3c88ae45a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.056133 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aace2-3485-4e12-bf0d-e3c88ae45a40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.076512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aace2-3485-4e12-bf0d-e3c88ae45a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-4e6aace2-3485-4e12-bf0d-e3c88ae45a40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:40.082321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:40.083223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:40.084081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 181/365] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:40.084739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aace2-3485-4e12-bf0d-e3c88ae45a40 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.088900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 185/366] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:40.091231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9d43b-0711-46c5-aa39-8444249788d4 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.206338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.234617 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9d43b-0711-46c5-aa39-8444249788d4 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.282182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.282808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.283083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.283350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.284046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:40.284353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.285738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.305702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 186/367] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:40.308866 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aace2-3485-4e12-bf0d-e3c88ae45a40 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.311140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.388569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b4c81-de06-44c0-9839-ca068bbe6763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.389217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4c81-de06-44c0-9839-ca068bbe6763 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.389497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4c81-de06-44c0-9839-ca068bbe6763 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.389772 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4c81-de06-44c0-9839-ca068bbe6763 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.392520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b4c81-de06-44c0-9839-ca068bbe6763 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.393988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b4c81-de06-44c0-9839-ca068bbe6763 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.399400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 182/368] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.400309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b4c81-de06-44c0-9839-ca068bbe6763 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.436107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.483517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6919b-3f7f-4745-8fbe-ce072d0601ce None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.544668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676c47f-688b-4cd2-a359-e7f16ef734f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.545523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676c47f-688b-4cd2-a359-e7f16ef734f0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.545819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676c47f-688b-4cd2-a359-e7f16ef734f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.546100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676c47f-688b-4cd2-a359-e7f16ef734f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.559229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.563356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b4c81-de06-44c0-9839-ca068bbe6763 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.610000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357b087-f9f1-4e47-8b10-47373181657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.610670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357b087-f9f1-4e47-8b10-47373181657f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.610952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357b087-f9f1-4e47-8b10-47373181657f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.611223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357b087-f9f1-4e47-8b10-47373181657f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.622789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357b087-f9f1-4e47-8b10-47373181657f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-5357b087-f9f1-4e47-8b10-47373181657f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:40.628955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:40.629869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:40.630686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:40.633553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 183/369] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:40.634544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676c47f-688b-4cd2-a359-e7f16ef734f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.635332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357b087-f9f1-4e47-8b10-47373181657f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.636228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676c47f-688b-4cd2-a359-e7f16ef734f0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.727460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.751035 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357b087-f9f1-4e47-8b10-47373181657f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.763325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 187/370] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:40.764340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676c47f-688b-4cd2-a359-e7f16ef734f0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.791490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3728f7f-b5f2-4b57-883e-6ba1f37c9ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.792619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3728f7f-b5f2-4b57-883e-6ba1f37c9ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.793121 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3728f7f-b5f2-4b57-883e-6ba1f37c9ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.793676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3728f7f-b5f2-4b57-883e-6ba1f37c9ad6 None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.795239 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3728f7f-b5f2-4b57-883e-6ba1f37c9ad6 None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.796920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3728f7f-b5f2-4b57-883e-6ba1f37c9ad6 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.799484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 184/371] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.800556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3728f7f-b5f2-4b57-883e-6ba1f37c9ad6 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.810930 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:40.871424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676c47f-688b-4cd2-a359-e7f16ef734f0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.910736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.911363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.911641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.911948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.912615 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:40.912921 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.914487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.917498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3728f7f-b5f2-4b57-883e-6ba1f37c9ad6 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:40.925344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 188/372] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.926634 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.960666 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bfcf3-2fbd-46c6-89d2-7e3f0d76aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:40.962020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bfcf3-2fbd-46c6-89d2-7e3f0d76aa53 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:40.962200 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bfcf3-2fbd-46c6-89d2-7e3f0d76aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:40.962428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bfcf3-2fbd-46c6-89d2-7e3f0d76aa53 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:40.963579 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bfcf3-2fbd-46c6-89d2-7e3f0d76aa53 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:40.965848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bfcf3-2fbd-46c6-89d2-7e3f0d76aa53 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:40.969004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 185/373] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:40.970014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bfcf3-2fbd-46c6-89d2-7e3f0d76aa53 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:40.990395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.041538 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196493c-2a15-45fd-a51d-a4223708b69c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.043035 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.078650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.079268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.079557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.079869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.080606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] RBAC: Adding query filter params (group.id=c4ef7987b30e441a9996a65ab2edd4e8, role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=84031b186a7b4222a649e89146434862) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:41.080916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.082348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.086898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bfcf3-2fbd-46c6-89d2-7e3f0d76aa53 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.088343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 189/374] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/role_assignments?group.id=c4ef7987b30e441a9996a65ab2edd4e8&scope.project.id=84031b186a7b4222a649e89146434862&role.id=4367ece899d646eeb2e2917530897f7f => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.089162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.130538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f71d6-3582-4e29-a802-5be9f88904be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.131177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f71d6-3582-4e29-a802-5be9f88904be None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.131458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f71d6-3582-4e29-a802-5be9f88904be None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.131731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f71d6-3582-4e29-a802-5be9f88904be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.207810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378017f4-aec5-48f2-9848-76020a167792 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.234605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f71d6-3582-4e29-a802-5be9f88904be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.236128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f71d6-3582-4e29-a802-5be9f88904be None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.255479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849fdee-30bd-4b8f-8a97-2874a6763aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.256157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849fdee-30bd-4b8f-8a97-2874a6763aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.256438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849fdee-30bd-4b8f-8a97-2874a6763aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.256712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849fdee-30bd-4b8f-8a97-2874a6763aa5 None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.260030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849fdee-30bd-4b8f-8a97-2874a6763aa5 None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.261997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849fdee-30bd-4b8f-8a97-2874a6763aa5 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.264494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 190/375] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.272122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849fdee-30bd-4b8f-8a97-2874a6763aa5 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.273629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.322907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.392561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 186/376] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:41.398715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f71d6-3582-4e29-a802-5be9f88904be None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.400926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849fdee-30bd-4b8f-8a97-2874a6763aa5 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.437167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.437787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.438072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.438339 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.439174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] RBAC: Adding query filter params (group.id=c4ef7987b30e441a9996a65ab2edd4e8, role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=84031b186a7b4222a649e89146434862) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:41.439488 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.440948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.447193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 191/377] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/role_assignments?group.id=c4ef7987b30e441a9996a65ab2edd4e8&scope.project.id=84031b186a7b4222a649e89146434862&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.532582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f71d6-3582-4e29-a802-5be9f88904be None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.554986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.580221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ea943-c723-4733-8748-048f1c79f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.580802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ea943-c723-4733-8748-048f1c79f44c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.581086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ea943-c723-4733-8748-048f1c79f44c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.581364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ea943-c723-4733-8748-048f1c79f44c None admin] PATH_INFO: `/v3/projects/9f45f1f2851042af834bdbb9f604e393` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.586404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ea943-c723-4733-8748-048f1c79f44c None admin] RBAC: Authorizing `identity:get_project(project_id=9f45f1f2851042af834bdbb9f604e393)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.587991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ea943-c723-4733-8748-048f1c79f44c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.590106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 187/378] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/projects/9f45f1f2851042af834bdbb9f604e393 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.595348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.713759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebec40-1afe-413e-b91c-b19bf4132cbc None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.714270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebec40-1afe-413e-b91c-b19bf4132cbc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.714270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebec40-1afe-413e-b91c-b19bf4132cbc None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.715897 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 188/379] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:41.721074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e0750-c330-43e3-b0e9-dda1ec827a41 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.721359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e0750-c330-43e3-b0e9-dda1ec827a41 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.721637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e0750-c330-43e3-b0e9-dda1ec827a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.723997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:41.726592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c6eb3-e69e-4a79-a1fc-b85280743303 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.751209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-943e0750-c330-43e3-b0e9-dda1ec827a41 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:41.752445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-943e0750-c330-43e3-b0e9-dda1ec827a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:41.773487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a39a1-144c-4f78-b3d7-829976df7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.774821 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a39a1-144c-4f78-b3d7-829976df7c28 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.775293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a39a1-144c-4f78-b3d7-829976df7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.775809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a39a1-144c-4f78-b3d7-829976df7c28 None admin] PATH_INFO: `/v3/groups/19c1d627aadd4b55b488e74a4f8db031` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.786013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a39a1-144c-4f78-b3d7-829976df7c28 None admin] RBAC: Authorizing `identity:get_group(group_id=19c1d627aadd4b55b488e74a4f8db031)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.787764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a39a1-144c-4f78-b3d7-829976df7c28 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.792680 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 192/380] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/groups/19c1d627aadd4b55b488e74a4f8db031 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:41.799224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a39a1-144c-4f78-b3d7-829976df7c28 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:41.906312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 189/381] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:41.921311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a39a1-144c-4f78-b3d7-829976df7c28 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:41.962609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:41.963237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:41.963518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:41.963803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:41.964610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] RBAC: Adding query filter params (group.id=19c1d627aadd4b55b488e74a4f8db031, role.id=32319452053845419798d329f1c194d4, scope.project.id=9f45f1f2851042af834bdbb9f604e393) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:41.964918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:41.966468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:41.972955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 193/382] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:41 2022] GET /identity/v3/role_assignments?group.id=19c1d627aadd4b55b488e74a4f8db031&scope.project.id=9f45f1f2851042af834bdbb9f604e393&role.id=32319452053845419798d329f1c194d4 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:42.220091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e0750-c330-43e3-b0e9-dda1ec827a41 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.323062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e0750-c330-43e3-b0e9-dda1ec827a41 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.337767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.358474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de73dd1-dc0f-4510-8f68-3109ecdd1ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.359141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73dd1-dc0f-4510-8f68-3109ecdd1ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.359393 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73dd1-dc0f-4510-8f68-3109ecdd1ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.359664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73dd1-dc0f-4510-8f68-3109ecdd1ce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.370865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de73dd1-dc0f-4510-8f68-3109ecdd1ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-0de73dd1-dc0f-4510-8f68-3109ecdd1ce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:42.375671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:42.376627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:42.377451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 190/383] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:42.383074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.412129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.449232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e94db5-b595-41b2-b1ac-d83d44a8d4db None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.449558 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e94db5-b595-41b2-b1ac-d83d44a8d4db None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.449765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e94db5-b595-41b2-b1ac-d83d44a8d4db None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.451676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 191/384] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:42.465157 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db125a-4a9d-4909-b036-859aabe75b19 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.465440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db125a-4a9d-4909-b036-859aabe75b19 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.465684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db125a-4a9d-4909-b036-859aabe75b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.494915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-53db125a-4a9d-4909-b036-859aabe75b19 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:42.496074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-53db125a-4a9d-4909-b036-859aabe75b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:42.514207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26aeee-51bc-4364-bead-b6f886a52a27 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.556087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.556852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.557134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.557405 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.558078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:42.558384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.559754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.569245 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 194/385] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:42.576098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.677299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 192/386] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:42.680217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.693156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3427f3-6251-4c55-a8d5-8c070163ee8d None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.728095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd2f65-be0e-4085-8855-9a5e0ad0513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.728736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd2f65-be0e-4085-8855-9a5e0ad0513d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.729033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd2f65-be0e-4085-8855-9a5e0ad0513d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.729293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd2f65-be0e-4085-8855-9a5e0ad0513d None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.730425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd2f65-be0e-4085-8855-9a5e0ad0513d None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.732095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd2f65-be0e-4085-8855-9a5e0ad0513d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.733941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 195/387] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:42.739474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db125a-4a9d-4909-b036-859aabe75b19 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:42.875754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db125a-4a9d-4909-b036-859aabe75b19 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:42.878440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:42.919142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2615-e306-441d-92b6-fefbd5699e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:42.920096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2615-e306-441d-92b6-fefbd5699e93 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:42.920567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2615-e306-441d-92b6-fefbd5699e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:42.921012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2615-e306-441d-92b6-fefbd5699e93 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:42.922290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c2615-e306-441d-92b6-fefbd5699e93 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:42.923945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c2615-e306-441d-92b6-fefbd5699e93 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:42.925744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 193/388] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:42 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:42.932343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd2f65-be0e-4085-8855-9a5e0ad0513d None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:43.069251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd2f65-be0e-4085-8855-9a5e0ad0513d None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:43.113499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59317b78-3491-433b-900e-1091fc5959ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:43.114167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317b78-3491-433b-900e-1091fc5959ae None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:43.114447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317b78-3491-433b-900e-1091fc5959ae None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:43.114722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59317b78-3491-433b-900e-1091fc5959ae None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e/groups/c4ef7987b30e441a9996a65ab2edd4e8/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:43.121018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59317b78-3491-433b-900e-1091fc5959ae None admin] RBAC: Authorizing `identity:create_grant(project_id=331fd9a5519d4bd0a191559b4f25947e, group_id=c4ef7987b30e441a9996a65ab2edd4e8, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:43.122539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59317b78-3491-433b-900e-1091fc5959ae None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:43.146643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 196/389] 10.222.0.55 () {58 vars in 1442 bytes} [Thu Sep 1 15:29:42 2022] PUT /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e/groups/c4ef7987b30e441a9996a65ab2edd4e8/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:43.270101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2615-e306-441d-92b6-fefbd5699e93 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:43.392255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2615-e306-441d-92b6-fefbd5699e93 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:43.431359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ce9d8-e3d1-4dc5-a0b9-257d36a88a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:43.432034 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce9d8-e3d1-4dc5-a0b9-257d36a88a91 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:43.432314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce9d8-e3d1-4dc5-a0b9-257d36a88a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:43.432588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce9d8-e3d1-4dc5-a0b9-257d36a88a91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:43.444110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ce9d8-e3d1-4dc5-a0b9-257d36a88a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-aa5ce9d8-e3d1-4dc5-a0b9-257d36a88a91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:43.450214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:43.451174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:43.451991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 194/390] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:43.461541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59317b78-3491-433b-900e-1091fc5959ae None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:43.484092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:43.573833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa8f3-9cc6-4e9d-8bf3-7039179b7e37 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:43.574173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa8f3-9cc6-4e9d-8bf3-7039179b7e37 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:43.574430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaa8f3-9cc6-4e9d-8bf3-7039179b7e37 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:43.580094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 195/391] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:43.582081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd373ab-d6d2-4053-89f9-ca3c28c013b1 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:43.582366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd373ab-d6d2-4053-89f9-ca3c28c013b1 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:43.582642 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd373ab-d6d2-4053-89f9-ca3c28c013b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:43.592394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59317b78-3491-433b-900e-1091fc5959ae None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:43.625901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6bd373ab-d6d2-4053-89f9-ca3c28c013b1 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:43.627230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6bd373ab-d6d2-4053-89f9-ca3c28c013b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:43.638235 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:43.638869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:43.639148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:43.639419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:43.640232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:43.640537 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:43.642017 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:43.655676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 197/392] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:43.661186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:43.662366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:43.725555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 196/393] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:43.760557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:43.783544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da315fec-12d5-468d-beba-6ab1723b36d0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:43.823076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45872f72-f94a-4152-bc83-e5dc434d7555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:43.823714 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45872f72-f94a-4152-bc83-e5dc434d7555 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:43.824021 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45872f72-f94a-4152-bc83-e5dc434d7555 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:43.824291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45872f72-f94a-4152-bc83-e5dc434d7555 None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:43.825453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45872f72-f94a-4152-bc83-e5dc434d7555 None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:43.826888 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45872f72-f94a-4152-bc83-e5dc434d7555 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:43.828726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 198/394] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:43 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:43.834008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd373ab-d6d2-4053-89f9-ca3c28c013b1 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:43.962473 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd373ab-d6d2-4053-89f9-ca3c28c013b1 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:44.002828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ab023-b899-4b41-93d1-3c022a09138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:44.003393 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ab023-b899-4b41-93d1-3c022a09138f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.003680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ab023-b899-4b41-93d1-3c022a09138f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.004029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ab023-b899-4b41-93d1-3c022a09138f None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.005174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ab023-b899-4b41-93d1-3c022a09138f None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:44.006622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ab023-b899-4b41-93d1-3c022a09138f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:44.009132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 197/395] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:43 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:44.016804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45872f72-f94a-4152-bc83-e5dc434d7555 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:44.070115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e3214-76ce-44dc-a6b5-54bd887045a6 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.070459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e3214-76ce-44dc-a6b5-54bd887045a6 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.070668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e3214-76ce-44dc-a6b5-54bd887045a6 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.072298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 198/396] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:44.077755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44e50-b493-4189-94f3-a2d128284fa2 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.078309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44e50-b493-4189-94f3-a2d128284fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.078780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc44e50-b493-4189-94f3-a2d128284fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.109219 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-bbc44e50-b493-4189-94f3-a2d128284fa2 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:44.110406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-bbc44e50-b493-4189-94f3-a2d128284fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:44.138976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:44.177709 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45872f72-f94a-4152-bc83-e5dc434d7555 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:44.193987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 199/397] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:44.195859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc44e50-b493-4189-94f3-a2d128284fa2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:44.229787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea46a-ee1e-4443-a9dd-dd3401da9737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:44.230469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea46a-ee1e-4443-a9dd-dd3401da9737 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.230750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea46a-ee1e-4443-a9dd-dd3401da9737 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.231026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea46a-ee1e-4443-a9dd-dd3401da9737 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e/groups/c4ef7987b30e441a9996a65ab2edd4e8/roles/a37614139c1f4c259c28b64ce0a959a2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.233514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ea46a-ee1e-4443-a9dd-dd3401da9737 None admin] RBAC: Authorizing `identity:create_grant(project_id=331fd9a5519d4bd0a191559b4f25947e, group_id=c4ef7987b30e441a9996a65ab2edd4e8, role_id=a37614139c1f4c259c28b64ce0a959a2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:44.235511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ea46a-ee1e-4443-a9dd-dd3401da9737 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:44.252985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 199/398] 10.222.0.55 () {58 vars in 1442 bytes} [Thu Sep 1 15:29:44 2022] PUT /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e/groups/c4ef7987b30e441a9996a65ab2edd4e8/roles/a37614139c1f4c259c28b64ce0a959a2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:44.384329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc44e50-b493-4189-94f3-a2d128284fa2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:44.397382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480c82-d4a2-483c-8b71-b2740f326417 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.398301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480c82-d4a2-483c-8b71-b2740f326417 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.398523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80480c82-d4a2-483c-8b71-b2740f326417 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.400330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 200/399] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:44.413280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991f07-222a-4f57-be49-416a981f2cf8 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.413560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991f07-222a-4f57-be49-416a981f2cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.413834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991f07-222a-4f57-be49-416a981f2cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.437693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:44.448992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4759d-cf46-48ae-993b-af01081bbc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:44.449649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4759d-cf46-48ae-993b-af01081bbc08 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.449938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4759d-cf46-48ae-993b-af01081bbc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.450209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4759d-cf46-48ae-993b-af01081bbc08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.454393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-39991f07-222a-4f57-be49-416a981f2cf8 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:44.455600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-39991f07-222a-4f57-be49-416a981f2cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:44.469239 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4759d-cf46-48ae-993b-af01081bbc08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-18e4759d-cf46-48ae-993b-af01081bbc08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:44.475335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:44.476335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:44.477124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:44.477798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 200/400] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:44.483586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4759d-cf46-48ae-993b-af01081bbc08 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:44.518349 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:44.564848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 201/401] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:44.621493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39991f07-222a-4f57-be49-416a981f2cf8 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:44.628927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4759d-cf46-48ae-993b-af01081bbc08 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:44.674992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:44.676147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.676572 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.677138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.678238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:44.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:44.680763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:44.695930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 201/402] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:44.699265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:44.747110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39991f07-222a-4f57-be49-416a981f2cf8 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:44.788496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80fb14-119a-4a9e-8d62-1031eabf6e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:44.790489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80fb14-119a-4a9e-8d62-1031eabf6e1b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.791016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80fb14-119a-4a9e-8d62-1031eabf6e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.791484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80fb14-119a-4a9e-8d62-1031eabf6e1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.795245 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:44.808641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80fb14-119a-4a9e-8d62-1031eabf6e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-0d80fb14-119a-4a9e-8d62-1031eabf6e1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:44.816171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:44.817039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:44.817829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:44.821544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 202/403] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:44.829531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80fb14-119a-4a9e-8d62-1031eabf6e1b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:44.863191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:44.898218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4919b-aea4-4595-a4a3-6ecbb0f73a66 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:44.972729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80fb14-119a-4a9e-8d62-1031eabf6e1b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:44.974512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eecae7-5c14-4383-be14-1ab5181b5a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:44.975383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eecae7-5c14-4383-be14-1ab5181b5a1a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:44.976434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eecae7-5c14-4383-be14-1ab5181b5a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:44.976988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eecae7-5c14-4383-be14-1ab5181b5a1a None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:44.978358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eecae7-5c14-4383-be14-1ab5181b5a1a None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:44.980096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eecae7-5c14-4383-be14-1ab5181b5a1a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:44.982225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 202/404] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:44 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:44.983208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eecae7-5c14-4383-be14-1ab5181b5a1a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.034301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.034954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.035211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.035483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.036641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:45.036952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.038766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.050792 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 203/405] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.052465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.109919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eecae7-5c14-4383-be14-1ab5181b5a1a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.131753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.152537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941127-653d-4a37-b4e7-f5394d549476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.153424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941127-653d-4a37-b4e7-f5394d549476 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.153847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941127-653d-4a37-b4e7-f5394d549476 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.154264 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941127-653d-4a37-b4e7-f5394d549476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.167698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c941127-653d-4a37-b4e7-f5394d549476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-3c941127-653d-4a37-b4e7-f5394d549476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:45.172810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:45.173942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:45.174779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:45.177331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 203/406] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:45.178286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941127-653d-4a37-b4e7-f5394d549476 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.185621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533127f-82c1-4d2f-a2dc-929bd0ce7bec None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.193348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.230885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2424e-c072-4e49-a49a-3ecfc1728aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.231623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2424e-c072-4e49-a49a-3ecfc1728aca None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.231940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2424e-c072-4e49-a49a-3ecfc1728aca None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.232218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2424e-c072-4e49-a49a-3ecfc1728aca None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.233459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2424e-c072-4e49-a49a-3ecfc1728aca None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.234902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2424e-c072-4e49-a49a-3ecfc1728aca None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.241754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 204/407] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.242726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2424e-c072-4e49-a49a-3ecfc1728aca None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.291201 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c941127-653d-4a37-b4e7-f5394d549476 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.326660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e247e-d267-4404-ab79-fcb0dd5b510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.327296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e247e-d267-4404-ab79-fcb0dd5b510a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.327579 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e247e-d267-4404-ab79-fcb0dd5b510a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.327878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e247e-d267-4404-ab79-fcb0dd5b510a None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.329042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e247e-d267-4404-ab79-fcb0dd5b510a None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.330590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e247e-d267-4404-ab79-fcb0dd5b510a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.332526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 204/408] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.333353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e247e-d267-4404-ab79-fcb0dd5b510a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.355518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2424e-c072-4e49-a49a-3ecfc1728aca None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.384244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.395014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.395634 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.396054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.396336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.397111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:45.397421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.399103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.408544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 205/409] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.409437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.414143 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.436868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e247e-d267-4404-ab79-fcb0dd5b510a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.471958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677f56-a8e0-4fc5-ba3f-1f2fa34ff9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.472834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677f56-a8e0-4fc5-ba3f-1f2fa34ff9db None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.473268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677f56-a8e0-4fc5-ba3f-1f2fa34ff9db None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.473616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677f56-a8e0-4fc5-ba3f-1f2fa34ff9db None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862/groups/c4ef7987b30e441a9996a65ab2edd4e8/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.475694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f677f56-a8e0-4fc5-ba3f-1f2fa34ff9db None admin] RBAC: Authorizing `identity:create_grant(project_id=84031b186a7b4222a649e89146434862, group_id=c4ef7987b30e441a9996a65ab2edd4e8, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.477226 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f677f56-a8e0-4fc5-ba3f-1f2fa34ff9db None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.500024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 205/410] 10.222.0.55 () {58 vars in 1442 bytes} [Thu Sep 1 15:29:45 2022] PUT /identity/v3/projects/84031b186a7b4222a649e89146434862/groups/c4ef7987b30e441a9996a65ab2edd4e8/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:45.501302 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677f56-a8e0-4fc5-ba3f-1f2fa34ff9db None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.525983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71b6d4-f4e8-44b7-8df3-269504716954 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.588442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29b12f-4a27-4d52-b898-41268a37840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.589016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b12f-4a27-4d52-b898-41268a37840f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.590855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b12f-4a27-4d52-b898-41268a37840f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.591145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b12f-4a27-4d52-b898-41268a37840f None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.593314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29b12f-4a27-4d52-b898-41268a37840f None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.596508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29b12f-4a27-4d52-b898-41268a37840f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.599339 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 206/411] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.608221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29b12f-4a27-4d52-b898-41268a37840f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.686447 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677f56-a8e0-4fc5-ba3f-1f2fa34ff9db None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.705327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.729061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110bad5-1e50-40ae-aa98-0c684c8e26e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.730002 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110bad5-1e50-40ae-aa98-0c684c8e26e3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.730427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110bad5-1e50-40ae-aa98-0c684c8e26e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.730843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110bad5-1e50-40ae-aa98-0c684c8e26e3 None admin] PATH_INFO: `/v3/groups/19c1d627aadd4b55b488e74a4f8db031` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.732230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110bad5-1e50-40ae-aa98-0c684c8e26e3 None admin] RBAC: Authorizing `identity:get_group(group_id=19c1d627aadd4b55b488e74a4f8db031)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.733850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110bad5-1e50-40ae-aa98-0c684c8e26e3 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.736817 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 206/412] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/groups/19c1d627aadd4b55b488e74a4f8db031 => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.741110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110bad5-1e50-40ae-aa98-0c684c8e26e3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:45.757301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:45.768713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29b12f-4a27-4d52-b898-41268a37840f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.814448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a942753-e461-47fe-9c4f-f0e744d8f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.815568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a942753-e461-47fe-9c4f-f0e744d8f02f None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.816082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a942753-e461-47fe-9c4f-f0e744d8f02f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.816560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a942753-e461-47fe-9c4f-f0e744d8f02f None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862/groups/c4ef7987b30e441a9996a65ab2edd4e8/roles/a37614139c1f4c259c28b64ce0a959a2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.819265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a942753-e461-47fe-9c4f-f0e744d8f02f None admin] RBAC: Authorizing `identity:create_grant(project_id=84031b186a7b4222a649e89146434862, group_id=c4ef7987b30e441a9996a65ab2edd4e8, role_id=a37614139c1f4c259c28b64ce0a959a2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.821650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a942753-e461-47fe-9c4f-f0e744d8f02f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.844859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 207/413] 10.222.0.55 () {58 vars in 1442 bytes} [Thu Sep 1 15:29:45 2022] PUT /identity/v3/projects/84031b186a7b4222a649e89146434862/groups/c4ef7987b30e441a9996a65ab2edd4e8/roles/a37614139c1f4c259c28b64ce0a959a2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:29:45.846528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4122c7-2868-407b-9aeb-88fdc34f5551 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.846944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4122c7-2868-407b-9aeb-88fdc34f5551 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.847350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4122c7-2868-407b-9aeb-88fdc34f5551 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.850104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 208/414] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:45.856552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62898ff-fcf2-4c9b-8dc8-c20b2ee30712 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.857015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62898ff-fcf2-4c9b-8dc8-c20b2ee30712 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.857766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62898ff-fcf2-4c9b-8dc8-c20b2ee30712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.903762 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-b62898ff-fcf2-4c9b-8dc8-c20b2ee30712 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:45.906637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b62898ff-fcf2-4c9b-8dc8-c20b2ee30712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:45.914067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110bad5-1e50-40ae-aa98-0c684c8e26e3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:45.969366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da1cbd-510e-4770-b5bb-86102d2cd504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:45.970027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da1cbd-510e-4770-b5bb-86102d2cd504 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:45.970308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da1cbd-510e-4770-b5bb-86102d2cd504 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:45.970584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da1cbd-510e-4770-b5bb-86102d2cd504 None admin] PATH_INFO: `/v3/projects/9f45f1f2851042af834bdbb9f604e393` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:45.971811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da1cbd-510e-4770-b5bb-86102d2cd504 None admin] RBAC: Authorizing `identity:get_project(project_id=9f45f1f2851042af834bdbb9f604e393)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:45.973510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da1cbd-510e-4770-b5bb-86102d2cd504 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:45.977878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 207/415] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:45 2022] GET /identity/v3/projects/9f45f1f2851042af834bdbb9f604e393 => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:45.984105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da1cbd-510e-4770-b5bb-86102d2cd504 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.048769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 209/416] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:46.093722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.122746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da1cbd-510e-4770-b5bb-86102d2cd504 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.169800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01a26c-7ab7-4972-aaf5-3f56a7372104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.170474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a26c-7ab7-4972-aaf5-3f56a7372104 None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.170756 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a26c-7ab7-4972-aaf5-3f56a7372104 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.171042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a26c-7ab7-4972-aaf5-3f56a7372104 None admin] PATH_INFO: `/v3/projects/9f45f1f2851042af834bdbb9f604e393/groups/19c1d627aadd4b55b488e74a4f8db031/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.173006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01a26c-7ab7-4972-aaf5-3f56a7372104 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f45f1f2851042af834bdbb9f604e393, group_id=19c1d627aadd4b55b488e74a4f8db031, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.174585 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01a26c-7ab7-4972-aaf5-3f56a7372104 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.202232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 208/417] 10.222.0.55 () {58 vars in 1442 bytes} [Thu Sep 1 15:29:45 2022] PUT /identity/v3/projects/9f45f1f2851042af834bdbb9f604e393/groups/19c1d627aadd4b55b488e74a4f8db031/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:29:46.405739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62898ff-fcf2-4c9b-8dc8-c20b2ee30712 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.457214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.526636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62898ff-fcf2-4c9b-8dc8-c20b2ee30712 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.572479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e748e-3f60-4b49-ac53-f8dcc8f20816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.573118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e748e-3f60-4b49-ac53-f8dcc8f20816 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.573396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e748e-3f60-4b49-ac53-f8dcc8f20816 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.573664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e748e-3f60-4b49-ac53-f8dcc8f20816 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.585300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e748e-3f60-4b49-ac53-f8dcc8f20816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-8f7e748e-3f60-4b49-ac53-f8dcc8f20816 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:46.590582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:46.591484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:46.592345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:46.594579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 210/418] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:46.601172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01a26c-7ab7-4972-aaf5-3f56a7372104 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.651243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5f90-48c6-491a-a924-0c09a5a3dad2 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.651896 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5f90-48c6-491a-a924-0c09a5a3dad2 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.652376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab5f90-48c6-491a-a924-0c09a5a3dad2 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.653967 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 211/419] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:46.666434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba573f8-7926-4f95-8f07-589b759a1346 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.667216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba573f8-7926-4f95-8f07-589b759a1346 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.667708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba573f8-7926-4f95-8f07-589b759a1346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.690689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-cba573f8-7926-4f95-8f07-589b759a1346 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:46.692437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-cba573f8-7926-4f95-8f07-589b759a1346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:46.766687 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 212/420] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:46.781192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01a26c-7ab7-4972-aaf5-3f56a7372104 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:46.837395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:46.838375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:46.838857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:46.839333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:46.840272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:46.840778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:46.842355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:46.844179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.856570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 209/421] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:46.862416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba573f8-7926-4f95-8f07-589b759a1346 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:46.900547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:46.973078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba573f8-7926-4f95-8f07-589b759a1346 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.008843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803bc4-caa1-4b32-b568-3d776873a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.009463 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803bc4-caa1-4b32-b568-3d776873a48c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.009745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803bc4-caa1-4b32-b568-3d776873a48c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.010019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68803bc4-caa1-4b32-b568-3d776873a48c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.083386 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68803bc4-caa1-4b32-b568-3d776873a48c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.084944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68803bc4-caa1-4b32-b568-3d776873a48c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.121991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.193499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 213/422] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:47.199662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.349820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080159d4-f6da-4e44-b85c-fae4699120f2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.371830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803bc4-caa1-4b32-b568-3d776873a48c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.426320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3963c-05b7-45f0-a464-51eec7cb4c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.432855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3963c-05b7-45f0-a464-51eec7cb4c79 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.433643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3963c-05b7-45f0-a464-51eec7cb4c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.434404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3963c-05b7-45f0-a464-51eec7cb4c79 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.436668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3963c-05b7-45f0-a464-51eec7cb4c79 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.442063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3963c-05b7-45f0-a464-51eec7cb4c79 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.447889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 210/423] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:47.453752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3963c-05b7-45f0-a464-51eec7cb4c79 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.580218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.587333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68803bc4-caa1-4b32-b568-3d776873a48c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.641449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3963c-05b7-45f0-a464-51eec7cb4c79 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.658266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef71d8-0cb4-41e5-b6fc-bf6dc3269c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.659748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef71d8-0cb4-41e5-b6fc-bf6dc3269c4f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.660550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef71d8-0cb4-41e5-b6fc-bf6dc3269c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.661310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef71d8-0cb4-41e5-b6fc-bf6dc3269c4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.673490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.676322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689213c4-4522-46e0-83b5-394fa12cce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.677216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689213c4-4522-46e0-83b5-394fa12cce0d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.677695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689213c4-4522-46e0-83b5-394fa12cce0d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.678164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689213c4-4522-46e0-83b5-394fa12cce0d None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.679516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689213c4-4522-46e0-83b5-394fa12cce0d None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.681919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689213c4-4522-46e0-83b5-394fa12cce0d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.683812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 211/424] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:47.690054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689213c4-4522-46e0-83b5-394fa12cce0d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.703077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef71d8-0cb4-41e5-b6fc-bf6dc3269c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-feef71d8-0cb4-41e5-b6fc-bf6dc3269c4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:47.721019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:47.721974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:47.722797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 214/425] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:47.728690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef71d8-0cb4-41e5-b6fc-bf6dc3269c4f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:47.799533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689213c4-4522-46e0-83b5-394fa12cce0d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.829752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:47.840655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6994b-5ad5-4c22-b718-e89cc5843a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.842267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6994b-5ad5-4c22-b718-e89cc5843a09 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.843207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6994b-5ad5-4c22-b718-e89cc5843a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.844566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6994b-5ad5-4c22-b718-e89cc5843a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.845506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6994b-5ad5-4c22-b718-e89cc5843a09 None admin] RBAC: Adding query filter params (group.id=c4ef7987b30e441a9996a65ab2edd4e8, role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=331fd9a5519d4bd0a191559b4f25947e) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:47.847280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6994b-5ad5-4c22-b718-e89cc5843a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.853658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6994b-5ad5-4c22-b718-e89cc5843a09 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.861933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 212/426] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/role_assignments?group.id=c4ef7987b30e441a9996a65ab2edd4e8&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=4367ece899d646eeb2e2917530897f7f => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:47.896908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef71d8-0cb4-41e5-b6fc-bf6dc3269c4f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:47.945726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:47.946748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.947294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.947786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.948701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:47.949213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:47.950818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2680c-4c77-4712-99f3-7286118b3ead None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.950946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:47.951246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2680c-4c77-4712-99f3-7286118b3ead None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.951662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2680c-4c77-4712-99f3-7286118b3ead None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.953867 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 213/427] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:29:47.964025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4fd88-9aaf-4872-b1a2-2b773bd76a36 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:47.964025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4fd88-9aaf-4872-b1a2-2b773bd76a36 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:47.964025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4fd88-9aaf-4872-b1a2-2b773bd76a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:47.971682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 215/428] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:47.977737 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.021735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c1f4fd88-9aaf-4872-b1a2-2b773bd76a36 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:48.023614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c1f4fd88-9aaf-4872-b1a2-2b773bd76a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:48.103203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 214/429] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:48.125853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.172733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4537db-bec6-4586-9c4a-73436fa03aee None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.208399 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add2496-2c7b-48a6-8a3b-d876a39c61da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.209018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add2496-2c7b-48a6-8a3b-d876a39c61da None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.209351 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add2496-2c7b-48a6-8a3b-d876a39c61da None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.209636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add2496-2c7b-48a6-8a3b-d876a39c61da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.282896 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add2496-2c7b-48a6-8a3b-d876a39c61da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.284402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add2496-2c7b-48a6-8a3b-d876a39c61da None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.320511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dc639-3ac2-434b-981a-a4d50e1fac4b None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.321009 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dc639-3ac2-434b-981a-a4d50e1fac4b None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.321104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dc639-3ac2-434b-981a-a4d50e1fac4b None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.322657 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 215/430] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:48.327677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c340f-402d-4c4d-ac62-425fbeacb0bc None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.328010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c340f-402d-4c4d-ac62-425fbeacb0bc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.328287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c340f-402d-4c4d-ac62-425fbeacb0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.348779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.359959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-675c340f-402d-4c4d-ac62-425fbeacb0bc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:48.362554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-675c340f-402d-4c4d-ac62-425fbeacb0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:48.401742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 216/431] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:29:48.408696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add2496-2c7b-48a6-8a3b-d876a39c61da None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.457732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 216/432] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:48.459572 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c340f-402d-4c4d-ac62-425fbeacb0bc None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.524785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add2496-2c7b-48a6-8a3b-d876a39c61da None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.536649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.572978 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26a29-c664-4c65-a28f-da7b1bb6710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.573849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26a29-c664-4c65-a28f-da7b1bb6710d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.574399 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26a29-c664-4c65-a28f-da7b1bb6710d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.574831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26a29-c664-4c65-a28f-da7b1bb6710d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.588797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26a29-c664-4c65-a28f-da7b1bb6710d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:48.594249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c340f-402d-4c4d-ac62-425fbeacb0bc None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-a8f26a29-c664-4c65-a28f-da7b1bb6710d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:48.595480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:48.596540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 15:29:48.597500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:48.599929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 217/433] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:29:48.606635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26a29-c664-4c65-a28f-da7b1bb6710d None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.635112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.646811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e25de2-28dd-4dc4-8d61-9e2961599ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.647855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e25de2-28dd-4dc4-8d61-9e2961599ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.648544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e25de2-28dd-4dc4-8d61-9e2961599ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.649001 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e25de2-28dd-4dc4-8d61-9e2961599ac2 None admin] PATH_INFO: `/v3/projects/331fd9a5519d4bd0a191559b4f25947e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.650272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e25de2-28dd-4dc4-8d61-9e2961599ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=331fd9a5519d4bd0a191559b4f25947e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.651978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e25de2-28dd-4dc4-8d61-9e2961599ac2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.654864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 217/434] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/projects/331fd9a5519d4bd0a191559b4f25947e => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:48.660730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e25de2-28dd-4dc4-8d61-9e2961599ac2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.739971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26a29-c664-4c65-a28f-da7b1bb6710d None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.784740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.785615 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.786042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.786469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.787288 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:48.787896 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.790049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.796413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e25de2-28dd-4dc4-8d61-9e2961599ac2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.798776 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 218/435] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:48.799581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.825485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.839233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d473b7f-6757-43cf-bce9-8137b576028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.841634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d473b7f-6757-43cf-bce9-8137b576028e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.841634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d473b7f-6757-43cf-bce9-8137b576028e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.841634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d473b7f-6757-43cf-bce9-8137b576028e None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.844834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d473b7f-6757-43cf-bce9-8137b576028e None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:48.844834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d473b7f-6757-43cf-bce9-8137b576028e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:48.846751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 218/436] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:48.847538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d473b7f-6757-43cf-bce9-8137b576028e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.900037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:48.922828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074909-942c-4f62-be4a-23a6555524ef None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.958462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d473b7f-6757-43cf-bce9-8137b576028e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:48.961880 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380a1e-2a27-486c-a7bf-edb3d046ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.962509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380a1e-2a27-486c-a7bf-edb3d046ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.962785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380a1e-2a27-486c-a7bf-edb3d046ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.963056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63380a1e-2a27-486c-a7bf-edb3d046ecd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:48.973387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63380a1e-2a27-486c-a7bf-edb3d046ecd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-63380a1e-2a27-486c-a7bf-edb3d046ecd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:48.979146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:48.980304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 219/437] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:48.981086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380a1e-2a27-486c-a7bf-edb3d046ecd3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:48.996063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab0083-76ab-4794-a430-67d148783605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:48.996615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0083-76ab-4794-a430-67d148783605 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:48.996896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0083-76ab-4794-a430-67d148783605 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:48.997173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab0083-76ab-4794-a430-67d148783605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.055027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.064452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab0083-76ab-4794-a430-67d148783605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:49.065910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab0083-76ab-4794-a430-67d148783605 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:49.081495 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63380a1e-2a27-486c-a7bf-edb3d046ecd3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.115264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03b592-7755-41d6-9a95-b14db0b4c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.115893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b592-7755-41d6-9a95-b14db0b4c2ef None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.116198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b592-7755-41d6-9a95-b14db0b4c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.116477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03b592-7755-41d6-9a95-b14db0b4c2ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.117208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03b592-7755-41d6-9a95-b14db0b4c2ef None admin] RBAC: Adding query filter params (group.id=c4ef7987b30e441a9996a65ab2edd4e8, role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=331fd9a5519d4bd0a191559b4f25947e) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:49.117520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03b592-7755-41d6-9a95-b14db0b4c2ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:49.118959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03b592-7755-41d6-9a95-b14db0b4c2ef None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:49.143823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 220/438] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/role_assignments?group.id=c4ef7987b30e441a9996a65ab2edd4e8&scope.project.id=331fd9a5519d4bd0a191559b4f25947e&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:49.143823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23dbc7-eddc-4683-b042-99be8a91763b None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.143823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23dbc7-eddc-4683-b042-99be8a91763b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.143823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23dbc7-eddc-4683-b042-99be8a91763b None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.143823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 221/439] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:49.143823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23dbc7-eddc-4683-b042-99be8a91763b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.144869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.172227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 219/440] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:49.173805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac60cb-5f43-4ec6-b99b-084c5e607e4e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.174097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac60cb-5f43-4ec6-b99b-084c5e607e4e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.174375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac60cb-5f43-4ec6-b99b-084c5e607e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.195935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-fdac60cb-5f43-4ec6-b99b-084c5e607e4e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:49.197170 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-fdac60cb-5f43-4ec6-b99b-084c5e607e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:49.253117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23dbc7-eddc-4683-b042-99be8a91763b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.274798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 220/441] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:49.275911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac60cb-5f43-4ec6-b99b-084c5e607e4e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.302838 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.309694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.310309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.310584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.310852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.311513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:49.311845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:49.313210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:49.322279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 222/442] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:49.327761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.402501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac60cb-5f43-4ec6-b99b-084c5e607e4e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.417472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.446202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23699533-5ac4-4312-9c53-cbdee8838219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.446844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23699533-5ac4-4312-9c53-cbdee8838219 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.447127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23699533-5ac4-4312-9c53-cbdee8838219 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.447825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23699533-5ac4-4312-9c53-cbdee8838219 None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.451229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23699533-5ac4-4312-9c53-cbdee8838219 None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:49.453144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23699533-5ac4-4312-9c53-cbdee8838219 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:49.455148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 221/443] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:49.461286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23699533-5ac4-4312-9c53-cbdee8838219 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.461899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbbf0d-5f69-41b3-9054-5d162cdecb7f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.509507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0297-a314-492f-a945-076373690d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.510462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0297-a314-492f-a945-076373690d77 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.510813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0297-a314-492f-a945-076373690d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.511140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0297-a314-492f-a945-076373690d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.579899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.590896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23699533-5ac4-4312-9c53-cbdee8838219 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.596628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0297-a314-492f-a945-076373690d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:49.598082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0297-a314-492f-a945-076373690d77 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:49.623499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109abec4-4109-42f8-8e1f-33ad5d3d731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.624147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abec4-4109-42f8-8e1f-33ad5d3d731c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.624425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abec4-4109-42f8-8e1f-33ad5d3d731c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.624693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abec4-4109-42f8-8e1f-33ad5d3d731c None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.625782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109abec4-4109-42f8-8e1f-33ad5d3d731c None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:49.627235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109abec4-4109-42f8-8e1f-33ad5d3d731c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:49.628801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 222/444] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:49.629554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109abec4-4109-42f8-8e1f-33ad5d3d731c None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.663550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.699066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 223/445] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:29:49.699916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0297-a314-492f-a945-076373690d77 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.733146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109abec4-4109-42f8-8e1f-33ad5d3d731c None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.765852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ac538-046a-4d1d-95fd-02c45486e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.766409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ac538-046a-4d1d-95fd-02c45486e6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.766694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ac538-046a-4d1d-95fd-02c45486e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.766961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ac538-046a-4d1d-95fd-02c45486e6b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.778156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ac538-046a-4d1d-95fd-02c45486e6b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-0f4ac538-046a-4d1d-95fd-02c45486e6b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:49.783331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:49.784407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 223/446] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:49.785379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ac538-046a-4d1d-95fd-02c45486e6b7 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.799437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0297-a314-492f-a945-076373690d77 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.804553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.833900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.834484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.834760 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.835025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.835740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] RBAC: Adding query filter params (group.id=c4ef7987b30e441a9996a65ab2edd4e8, role.id=4367ece899d646eeb2e2917530897f7f, scope.project.id=84031b186a7b4222a649e89146434862) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:49.836074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:49.837502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:49.842983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 224/447] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/role_assignments?group.id=c4ef7987b30e441a9996a65ab2edd4e8&scope.project.id=84031b186a7b4222a649e89146434862&role.id=4367ece899d646eeb2e2917530897f7f => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:49.843740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.877748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:49.902195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ac538-046a-4d1d-95fd-02c45486e6b7 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:49.940045 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41132f8b-7a89-4d23-b3c2-7f335ccd8c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:49.940690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41132f8b-7a89-4d23-b3c2-7f335ccd8c8d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:49.940970 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41132f8b-7a89-4d23-b3c2-7f335ccd8c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:49.941240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41132f8b-7a89-4d23-b3c2-7f335ccd8c8d None admin] PATH_INFO: `/v3/projects/84031b186a7b4222a649e89146434862` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:49.942393 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41132f8b-7a89-4d23-b3c2-7f335ccd8c8d None admin] RBAC: Authorizing `identity:get_project(project_id=84031b186a7b4222a649e89146434862)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:49.943887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41132f8b-7a89-4d23-b3c2-7f335ccd8c8d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:49.946338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 224/448] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/projects/84031b186a7b4222a649e89146434862 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:49.952005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41132f8b-7a89-4d23-b3c2-7f335ccd8c8d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:49.968552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82cab4-c08f-45d2-b522-18ae96ef5657 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.012633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.013503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.013626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.013800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.014472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:50.014775 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.017960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.026902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 225/449] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:50.033292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.057251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.076488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41132f8b-7a89-4d23-b3c2-7f335ccd8c8d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.115848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce55e4-f313-48b4-bb1f-ad780dcd5fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.117087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce55e4-f313-48b4-bb1f-ad780dcd5fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.117366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce55e4-f313-48b4-bb1f-ad780dcd5fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.117639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce55e4-f313-48b4-bb1f-ad780dcd5fc9 None admin] PATH_INFO: `/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.119741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce55e4-f313-48b4-bb1f-ad780dcd5fc9 None admin] RBAC: Authorizing `identity:get_group(group_id=c4ef7987b30e441a9996a65ab2edd4e8)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.122876 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce55e4-f313-48b4-bb1f-ad780dcd5fc9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.123454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 225/450] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:49 2022] GET /identity/v3/groups/c4ef7987b30e441a9996a65ab2edd4e8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:50.129471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce55e4-f313-48b4-bb1f-ad780dcd5fc9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.142267 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.152141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759343a-a860-4b0c-9cf9-96716fc80f53 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.189697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7b01-f064-484a-853c-b7af99839681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.190315 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7b01-f064-484a-853c-b7af99839681 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.190596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7b01-f064-484a-853c-b7af99839681 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.190873 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7b01-f064-484a-853c-b7af99839681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.241057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce55e4-f313-48b4-bb1f-ad780dcd5fc9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.259691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7b01-f064-484a-853c-b7af99839681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.261220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7b01-f064-484a-853c-b7af99839681 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.273761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.274312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.274586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.274864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.275584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] RBAC: Adding query filter params (group.id=c4ef7987b30e441a9996a65ab2edd4e8, role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=84031b186a7b4222a649e89146434862) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:50.275928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.277348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.282989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 226/451] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/role_assignments?group.id=c4ef7987b30e441a9996a65ab2edd4e8&scope.project.id=84031b186a7b4222a649e89146434862&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:50.354888 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.365559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 226/452] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:50.372144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.391825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.472982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b4cbd-ba39-450c-843e-264455b9bfb8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.507411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea8c4d-a12b-4785-994c-8ce4d494f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.508082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea8c4d-a12b-4785-994c-8ce4d494f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.508366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea8c4d-a12b-4785-994c-8ce4d494f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.508634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea8c4d-a12b-4785-994c-8ce4d494f4b3 None admin] PATH_INFO: `/v3/projects/9f45f1f2851042af834bdbb9f604e393` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.509752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea8c4d-a12b-4785-994c-8ce4d494f4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=9f45f1f2851042af834bdbb9f604e393)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.511197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea8c4d-a12b-4785-994c-8ce4d494f4b3 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.513060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 227/453] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/projects/9f45f1f2851042af834bdbb9f604e393 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:50.518506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7b01-f064-484a-853c-b7af99839681 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.622315 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7b01-f064-484a-853c-b7af99839681 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.654798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bbe19-5b00-4cb5-b391-e4ba66bac39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.655423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bbe19-5b00-4cb5-b391-e4ba66bac39d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.655697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bbe19-5b00-4cb5-b391-e4ba66bac39d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.655994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bbe19-5b00-4cb5-b391-e4ba66bac39d None admin] PATH_INFO: `/v3/groups/19c1d627aadd4b55b488e74a4f8db031` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.657079 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bbe19-5b00-4cb5-b391-e4ba66bac39d None admin] RBAC: Authorizing `identity:get_group(group_id=19c1d627aadd4b55b488e74a4f8db031)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.658500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bbe19-5b00-4cb5-b391-e4ba66bac39d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.660075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 227/454] 10.222.0.55 () {56 vars in 1180 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/groups/19c1d627aadd4b55b488e74a4f8db031 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:50.666514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea8c4d-a12b-4785-994c-8ce4d494f4b3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:50.746740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:50.760960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea8c4d-a12b-4785-994c-8ce4d494f4b3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:50.793323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65210b8-81da-4a96-855a-02960568b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:50.793908 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65210b8-81da-4a96-855a-02960568b33d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:50.794186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65210b8-81da-4a96-855a-02960568b33d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:50.794459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65210b8-81da-4a96-855a-02960568b33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:50.795169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65210b8-81da-4a96-855a-02960568b33d None admin] RBAC: Adding query filter params (group.id=19c1d627aadd4b55b488e74a4f8db031, role.id=32319452053845419798d329f1c194d4, scope.project.id=9f45f1f2851042af834bdbb9f604e393) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:50.795474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65210b8-81da-4a96-855a-02960568b33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:50.796917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65210b8-81da-4a96-855a-02960568b33d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:50.802334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 228/455] 10.222.0.55 () {56 vars in 1376 bytes} [Thu Sep 1 15:29:50 2022] GET /identity/v3/role_assignments?group.id=19c1d627aadd4b55b488e74a4f8db031&scope.project.id=9f45f1f2851042af834bdbb9f604e393&role.id=32319452053845419798d329f1c194d4 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:53.050194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465010-c434-427a-8bd7-cd961c203e89 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.051135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465010-c434-427a-8bd7-cd961c203e89 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.051632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd465010-c434-427a-8bd7-cd961c203e89 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.054078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 228/456] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:53.059420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712413-0b79-4f06-b82f-8ae945814926 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.060256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712413-0b79-4f06-b82f-8ae945814926 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.060731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f712413-0b79-4f06-b82f-8ae945814926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.088755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-2f712413-0b79-4f06-b82f-8ae945814926 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:53.090297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2f712413-0b79-4f06-b82f-8ae945814926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:53.181266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 229/457] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:53.228104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3a31-1171-41ef-9d0b-722177d36215 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.228707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3a31-1171-41ef-9d0b-722177d36215 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.229185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3a31-1171-41ef-9d0b-722177d36215 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.230750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 229/458] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:53.235805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c35d-84e7-46d3-8fe4-5eec9209d842 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.236307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c35d-84e7-46d3-8fe4-5eec9209d842 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.236775 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c35d-84e7-46d3-8fe4-5eec9209d842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.260789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-0a86c35d-84e7-46d3-8fe4-5eec9209d842 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:53.262327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-0a86c35d-84e7-46d3-8fe4-5eec9209d842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:53.346777 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 230/459] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:53.558862 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3a31-1171-41ef-9d0b-722177d36215 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:53.629809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.681358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86c35d-84e7-46d3-8fe4-5eec9209d842 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:53.695251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f3a31-1171-41ef-9d0b-722177d36215 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:53.696118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.760428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45420ccd-9ce9-4f6d-a803-fc2ba02125ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.761077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45420ccd-9ce9-4f6d-a803-fc2ba02125ba None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.761357 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45420ccd-9ce9-4f6d-a803-fc2ba02125ba None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.761630 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45420ccd-9ce9-4f6d-a803-fc2ba02125ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.775617 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45420ccd-9ce9-4f6d-a803-fc2ba02125ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.777190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45420ccd-9ce9-4f6d-a803-fc2ba02125ba None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-45420ccd-9ce9-4f6d-a803-fc2ba02125ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:53.795798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:53.796769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:53.798130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:53.798130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:53.798130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:53.798130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 230/460] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:53.800770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d026c3-de93-4344-90de-ef6918ccdf71 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.800770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d026c3-de93-4344-90de-ef6918ccdf71 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.800770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d026c3-de93-4344-90de-ef6918ccdf71 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.801030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 231/461] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:53.802400 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d026c3-de93-4344-90de-ef6918ccdf71 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:53.831549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86c35d-84e7-46d3-8fe4-5eec9209d842 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:53.879112 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21d515-eb33-4c00-8f29-2fe2857df758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.879878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21d515-eb33-4c00-8f29-2fe2857df758 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.880708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21d515-eb33-4c00-8f29-2fe2857df758 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.880982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21d515-eb33-4c00-8f29-2fe2857df758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.894746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21d515-eb33-4c00-8f29-2fe2857df758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.896988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21d515-eb33-4c00-8f29-2fe2857df758 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:53.918861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d026c3-de93-4344-90de-ef6918ccdf71 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-ac21d515-eb33-4c00-8f29-2fe2857df758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:53.919096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:53.920887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:53.922450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:53.922450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:53.922450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:53.922450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 231/462] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:53.922450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636baac0-46ca-400d-8b4a-aaecc17aaca8 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.922450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636baac0-46ca-400d-8b4a-aaecc17aaca8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.922450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636baac0-46ca-400d-8b4a-aaecc17aaca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.940036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:53.945860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-636baac0-46ca-400d-8b4a-aaecc17aaca8 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:53.947662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-636baac0-46ca-400d-8b4a-aaecc17aaca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:53.984352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:53.985811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:53.986334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:53.986857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:53.987740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:53.988275 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:53.989968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.010685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 232/463] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:54.012330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.015926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.034304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 232/464] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:54.035490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636baac0-46ca-400d-8b4a-aaecc17aaca8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.154935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636baac0-46ca-400d-8b4a-aaecc17aaca8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.191691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd822ba2-f5c4-47c3-9e49-0ed0c2241900 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.198740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743c0c2-670b-4b6a-844a-cf565db506d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.199535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c0c2-670b-4b6a-844a-cf565db506d0 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.200022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c0c2-670b-4b6a-844a-cf565db506d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.200508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743c0c2-670b-4b6a-844a-cf565db506d0 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.201305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743c0c2-670b-4b6a-844a-cf565db506d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.202994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743c0c2-670b-4b6a-844a-cf565db506d0 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.229804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 233/465] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:54.231424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e445-207d-4fe4-bc24-ec0876a98779 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.231931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e445-207d-4fe4-bc24-ec0876a98779 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.232135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.232560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e445-207d-4fe4-bc24-ec0876a98779 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.232988 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.233359 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.233723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.234539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:54.234929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.235074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 234/466] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:54.236559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.241252 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c06728-e2b6-4075-b81c-d552f04551b0 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.241760 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c06728-e2b6-4075-b81c-d552f04551b0 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.242237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c06728-e2b6-4075-b81c-d552f04551b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.251221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 233/467] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:54.257331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.266130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c9c06728-e2b6-4075-b81c-d552f04551b0 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:54.268372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c9c06728-e2b6-4075-b81c-d552f04551b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:54.305919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.340008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.373095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 235/468] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:54.374827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c06728-e2b6-4075-b81c-d552f04551b0 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.402154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79973-fc19-49ee-b3c3-66d01c2d485e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.468010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20b049-5e9d-4d06-9abb-61279d3e893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.468757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b049-5e9d-4d06-9abb-61279d3e893b None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.468941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b049-5e9d-4d06-9abb-61279d3e893b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.469191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20b049-5e9d-4d06-9abb-61279d3e893b None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.469863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20b049-5e9d-4d06-9abb-61279d3e893b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.471328 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20b049-5e9d-4d06-9abb-61279d3e893b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.494966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c06728-e2b6-4075-b81c-d552f04551b0 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.495627 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 234/469] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:54.496964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9d7a-66a4-4cce-a220-1cdccc7661c1 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.497408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9d7a-66a4-4cce-a220-1cdccc7661c1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.497695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9d7a-66a4-4cce-a220-1cdccc7661c1 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.499928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 235/470] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:54.506441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45011-2765-45a5-bd52-2648b8f97b67 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.506816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45011-2765-45a5-bd52-2648b8f97b67 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.507567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45011-2765-45a5-bd52-2648b8f97b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.532520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-eca45011-2765-45a5-bd52-2648b8f97b67 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:54.533767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-eca45011-2765-45a5-bd52-2648b8f97b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:54.541232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.542524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.543038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.543555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.556702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.558763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:54.577161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:54.578111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:54.578953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:54.578953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:54.578953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:54.581020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 236/471] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:54.587624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.609815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 236/472] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:54.624239 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.660867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45011-2765-45a5-bd52-2648b8f97b67 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.687934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.706454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05cdc-8966-4e2f-89f4-a9d7250284ee None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.747346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.748019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.748303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.748631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.749275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:54.749663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.751179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.764707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 237/473] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:54.773350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.801285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45011-2765-45a5-bd52-2648b8f97b67 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.840184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.840817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.841098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.841433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.853907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.855424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:54.872363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:54.873286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:54.874123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:54.874123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:54.874123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:54.878017 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 237/474] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:54.879670 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.898170 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.911831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da724694-1434-4d47-927d-d3f566d70257 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:54.953875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:54.957721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baceb0-f8df-446e-b976-27f1eedea6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:54.958605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baceb0-f8df-446e-b976-27f1eedea6cf None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:54.959110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baceb0-f8df-446e-b976-27f1eedea6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:54.959582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baceb0-f8df-446e-b976-27f1eedea6cf None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:54.960994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baceb0-f8df-446e-b976-27f1eedea6cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:54.963152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baceb0-f8df-446e-b976-27f1eedea6cf None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:54.990196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 238/475] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:54.991346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baceb0-f8df-446e-b976-27f1eedea6cf None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:54.992214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3fb16-3edb-40db-84d5-95a5f1a47efe None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.080606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.081185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.081468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.081743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.082401 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:55.082705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.088321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.114203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 238/476] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:29:55.115066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baceb0-f8df-446e-b976-27f1eedea6cf None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.121600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.157092 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.158419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.158903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.159412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.160379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.162213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.184482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.sql.core [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 15:29:55.184482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 15:29:55.184482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [parameters: {'id': '5bb25c9e8a4d417ab4a324fc366912ce', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 15:29:55.184482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81745) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application result.read() Sep 01 15:29:55.214322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:29:55.215265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application yield resource Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise self.value Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application session.commit() Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 15:29:55.216277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.session.flush() Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application compat.raise_( Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 15:29:55.217144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:29:55.218030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application result.read() Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:29:55.218850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [parameters: {'id': '5bb25c9e8a4d417ab4a324fc366912ce', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:55.219624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 15:29:55.223495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:55.225606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 239/477] 10.222.0.55 () {60 vars in 1131 bytes} [Thu Sep 1 15:29:54 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:55.225606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.239222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.291205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00186-ede9-40ad-a04e-255e52713cb3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.332432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:55.341504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb0420-ceea-47e7-ae02-0d8745e50992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.342553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0420-ceea-47e7-ae02-0d8745e50992 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.343394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0420-ceea-47e7-ae02-0d8745e50992 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.343848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0420-ceea-47e7-ae02-0d8745e50992 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.344914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb0420-ceea-47e7-ae02-0d8745e50992 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.346349 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c17ee8-5326-46cd-bb79-63a2ef9ee40e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.346704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb0420-ceea-47e7-ae02-0d8745e50992 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.384024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 239/478] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:55 2022] POST /identity/v3/users => generated 249 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:55.399113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ae5f4-7a47-4111-857c-cccf3a2ae877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.399893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae5f4-7a47-4111-857c-cccf3a2ae877 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.400239 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae5f4-7a47-4111-857c-cccf3a2ae877 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.400622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ae5f4-7a47-4111-857c-cccf3a2ae877 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.413376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ae5f4-7a47-4111-857c-cccf3a2ae877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-1e4ae5f4-7a47-4111-857c-cccf3a2ae877 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:55.419135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:55.420363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 15:29:55.421353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:55.422336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 240/479] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:55.427998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb0420-ceea-47e7-ae02-0d8745e50992 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:55.548115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb0420-ceea-47e7-ae02-0d8745e50992 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:55.585104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29829cb3-fd85-426c-81e0-b094e7b29cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:55.585795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29829cb3-fd85-426c-81e0-b094e7b29cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:55.586141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29829cb3-fd85-426c-81e0-b094e7b29cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:55.586481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29829cb3-fd85-426c-81e0-b094e7b29cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:55.587225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29829cb3-fd85-426c-81e0-b094e7b29cb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:55.587599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29829cb3-fd85-426c-81e0-b094e7b29cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:55.589082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29829cb3-fd85-426c-81e0-b094e7b29cb1 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:55.597801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 240/480] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:29:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:56.827399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396649-e886-4f27-8659-acaa12b52e4f None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.827986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396649-e886-4f27-8659-acaa12b52e4f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.827986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b396649-e886-4f27-8659-acaa12b52e4f None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.829476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 241/481] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:56.836464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9954d0-ab17-464d-832b-a345142e0f39 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.836867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9954d0-ab17-464d-832b-a345142e0f39 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.837062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9954d0-ab17-464d-832b-a345142e0f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.865130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-fc9954d0-ab17-464d-832b-a345142e0f39 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:56.866832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-fc9954d0-ab17-464d-832b-a345142e0f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:56.915293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:56.948355 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 241/482] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:29:56.953375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93983a32-558c-4caa-a273-1a417a616608 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.953661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93983a32-558c-4caa-a273-1a417a616608 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.953937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93983a32-558c-4caa-a273-1a417a616608 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.955542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 242/483] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:56.960451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb5ff8-dc1c-4f05-b996-471a653e8d7c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:56.960734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb5ff8-dc1c-4f05-b996-471a653e8d7c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:56.961008 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb5ff8-dc1c-4f05-b996-471a653e8d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:56.979997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3ebb5ff8-dc1c-4f05-b996-471a653e8d7c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:56.981173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3ebb5ff8-dc1c-4f05-b996-471a653e8d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:57.078154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 242/484] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:57.274387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93983a32-558c-4caa-a273-1a417a616608 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:57.368051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:57.413998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93983a32-558c-4caa-a273-1a417a616608 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:57.462326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7513-ead2-4510-9162-1f109433c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:57.462967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7513-ead2-4510-9162-1f109433c4fe None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.463248 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7513-ead2-4510-9162-1f109433c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.463525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7513-ead2-4510-9162-1f109433c4fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.480518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e7513-ead2-4510-9162-1f109433c4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-059e7513-ead2-4510-9162-1f109433c4fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:57.485323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:57.486214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:57.487378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 243/485] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:57.496572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb5ff8-dc1c-4f05-b996-471a653e8d7c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:57.574297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccfea4-cb0b-4dce-ae24-20916a7dfbf0 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.574612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccfea4-cb0b-4dce-ae24-20916a7dfbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.574848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccfea4-cb0b-4dce-ae24-20916a7dfbf0 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.576503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 244/486] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:57.587110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76ada6-d7fb-4ec3-9881-273f72f48569 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.587402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76ada6-d7fb-4ec3-9881-273f72f48569 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.587687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76ada6-d7fb-4ec3-9881-273f72f48569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.620379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-8c76ada6-d7fb-4ec3-9881-273f72f48569 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:57.621494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8c76ada6-d7fb-4ec3-9881-273f72f48569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:57.653901 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb5ff8-dc1c-4f05-b996-471a653e8d7c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:57.666383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:57.699111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 245/487] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:57.699111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76ada6-d7fb-4ec3-9881-273f72f48569 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:57.717188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:57.718516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.719005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.719483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.720926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:57.721441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:57.723558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:57.738185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 243/488] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:57.746224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:57.790082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:57.846230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76ada6-d7fb-4ec3-9881-273f72f48569 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:57.869258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3576ec-3cce-4810-b861-e2f91e37b371 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:57.892499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abb6e7-a292-41e5-8d78-cad0ba412eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:57.893450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abb6e7-a292-41e5-8d78-cad0ba412eba None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.893926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abb6e7-a292-41e5-8d78-cad0ba412eba None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.894445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abb6e7-a292-41e5-8d78-cad0ba412eba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.908505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abb6e7-a292-41e5-8d78-cad0ba412eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f7abb6e7-a292-41e5-8d78-cad0ba412eba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:57.913361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:57.914465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:57.915265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 246/489] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:57.915972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d59a9-d301-4c2a-be64-f0eec330ca75 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.915972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d59a9-d301-4c2a-be64-f0eec330ca75 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.916899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d59a9-d301-4c2a-be64-f0eec330ca75 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.921426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 247/490] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:57.922438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc114-d51f-485e-8752-55a19a5aab71 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.922723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc114-d51f-485e-8752-55a19a5aab71 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.922997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc114-d51f-485e-8752-55a19a5aab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.926927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:57.927703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:57.928138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:57.928563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:57.941637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-8b3cc114-d51f-485e-8752-55a19a5aab71 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:57.941938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:57.943161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8b3cc114-d51f-485e-8752-55a19a5aab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:57.943577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:57.963890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:57.964763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:57.965597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:57.965597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:57.965597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:57.968093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 244/491] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:57.969500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.011245 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.032739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 248/492] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:58.033697 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cc114-d51f-485e-8752-55a19a5aab71 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.111422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.113298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd366e7-181f-4c6d-8df9-a4b11b45ed36 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.152149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.152677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.152955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.153324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.154102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:58.154407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.155795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.164935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 245/493] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:29:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:58.165743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.181868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cc114-d51f-485e-8752-55a19a5aab71 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.220746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.221355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.222059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.222342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.223005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:58.223287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.224709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.237003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 249/494] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:58.242530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.252375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.272246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d768-c2a3-4535-b978-661d2a7d293a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.309349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d360b6f-e2e2-4b62-a7e5-a204d5489b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.309985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d360b6f-e2e2-4b62-a7e5-a204d5489b85 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.310270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d360b6f-e2e2-4b62-a7e5-a204d5489b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.310547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d360b6f-e2e2-4b62-a7e5-a204d5489b85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.322116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d360b6f-e2e2-4b62-a7e5-a204d5489b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-0d360b6f-e2e2-4b62-a7e5-a204d5489b85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:58.327410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:58.328305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:58.329085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 246/495] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:58.329944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76b5cf-1dd1-4f16-94de-db26bfded0ca None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.329944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76b5cf-1dd1-4f16-94de-db26bfded0ca None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.330520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76b5cf-1dd1-4f16-94de-db26bfded0ca None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.331576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 247/496] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:29:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:29:58.332149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76b5cf-1dd1-4f16-94de-db26bfded0ca None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.351328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af7df-4e74-4fb3-b9b9-226c5367390f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.361467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.385896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.386521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.387226 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.387511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.397737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.399451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:58.413358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:58.414420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:58.415703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:58.415703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:58.415703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:58.415703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 250/497] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:58.416610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.433793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76b5cf-1dd1-4f16-94de-db26bfded0ca None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.467130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.467753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.468067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.468341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.477040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.478489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:29:58.491662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:58.492742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 248/498] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:58.494199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.498256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.515903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022654d-a432-4803-8259-d1fa15e41cf2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.550278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab304346-030c-4cfd-be06-90454b95cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.550904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab304346-030c-4cfd-be06-90454b95cf78 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.551186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab304346-030c-4cfd-be06-90454b95cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.551458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab304346-030c-4cfd-be06-90454b95cf78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.562091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab304346-030c-4cfd-be06-90454b95cf78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-ab304346-030c-4cfd-be06-90454b95cf78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:29:58.567284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:58.568225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:58.569005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 251/499] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:58.569939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff75ca8-285a-4f10-b709-d1a66d3f127e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.569939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff75ca8-285a-4f10-b709-d1a66d3f127e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.570062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff75ca8-285a-4f10-b709-d1a66d3f127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.587420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-eff75ca8-285a-4f10-b709-d1a66d3f127e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:29:58.588638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-eff75ca8-285a-4f10-b709-d1a66d3f127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:29:58.594974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235474e-3ccd-4b06-a557-9646f249ada1 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.604971 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.629077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.629683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.629960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.630230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.630892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:58.631194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.632605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.640278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 249/500] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:58.641054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.658789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 252/501] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:29:58.659738 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff75ca8-285a-4f10-b709-d1a66d3f127e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.714695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.754060 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988152a-cb28-4726-8234-3870c3e36318 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.765774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff75ca8-285a-4f10-b709-d1a66d3f127e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.789284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.789891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.790178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.790455 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.791096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:58.791403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.792815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.800724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.801317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.801592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.801868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.802583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:58.802884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.804893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.810173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 250/502] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:58.810173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.849626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 253/503] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:58.849626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.861807 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.914568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a029e-585c-4b31-8b91-6bfe9b38957f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.941839 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:58.953805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.954420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.954698 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.955415 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:58.955621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:58.955951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:58.956742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59acdd-7db6-44ee-b676-b062c5325998 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:58.957327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:58.965598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 251/504] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:58.966146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:58.992489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:58.993121 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:58.993404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:58.993670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.003443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.004953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:59.019783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.020658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:59.021485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:59.021485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:59.021485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:59.021485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 254/505] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:59.021787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.067469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e6e8-9b50-4819-b984-f4822ead5fdb None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.081750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.100392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.101012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.101289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.101564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.108863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.110292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.120440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145051b-8ccc-4a9d-bcd3-cc7b4659d3e2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:29:59.121639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.122506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:59.123380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 252/506] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:59.123977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.155727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3ed99-5033-45e7-ade5-0f5d99883fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.156359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ed99-5033-45e7-ade5-0f5d99883fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.156634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ed99-5033-45e7-ade5-0f5d99883fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.156904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3ed99-5033-45e7-ade5-0f5d99883fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.173049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.224686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3ed99-5033-45e7-ade5-0f5d99883fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.225872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8c34-ae28-4538-8267-02d20b899af3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.226593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3ed99-5033-45e7-ade5-0f5d99883fd9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.260053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.260672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.260950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.261221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.271461 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.273234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.283614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:59.287307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.288722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:59.289611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:59.289611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:59.289611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:59.289611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 253/507] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:59.289823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.324638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 255/508] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:29:59.325482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3ed99-5033-45e7-ade5-0f5d99883fd9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.385825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.388773 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c677c4-51f2-45e9-9390-95854f4df05c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.421756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.422386 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.422666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.422939 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.424118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3ed99-5033-45e7-ade5-0f5d99883fd9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.433871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.435325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:59.449369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.450344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:59.451353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:59.451353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:59.451353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:59.451353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 254/509] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:59.451749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.461933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.462538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.462842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.463114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.463749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:59.464074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.465445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.481186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 256/510] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:59.481186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.501024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.553350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b57744-9287-4391-8050-25095b8abf82 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.575062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae832a3-2496-40e0-b4e4-4515ea20b7e9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.587858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.588467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.588751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.589028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.589762 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:59.590070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.591499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.608449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.609042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.609319 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.609589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.610215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:59.610512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.611995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.623187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 257/511] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:59.623987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.635970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 255/512] 10.222.0.55 () {56 vars in 1137 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:59.635970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.644118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.708797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.727902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a2a92-a05f-459a-b2d4-64ad96e5b88b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.732631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8d8b8-871c-4940-9114-68c5175f4381 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.759603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.760250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.760523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.760797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.765181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.765788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.766072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.766351 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.767002 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:29:59.767313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.768720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.770432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.771970 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.780446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 256/513] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:29:59.781226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:29:59.792218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.793151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:29:59.794149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:29:59.794149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:29:59.794149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:29:59.794149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 258/514] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:59.794149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.849864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.881901 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e8c3e-ce21-4713-b384-0fdb2bdcab11 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.892218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9954958-368a-4d1f-95ce-d55163cfb6de None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:29:59.916515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.917141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.917420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.917695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.925001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.925937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84457c-3c4e-44b8-9ab5-18c3e350596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:29:59.926452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.926552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84457c-3c4e-44b8-9ab5-18c3e350596f None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:29:59.926809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84457c-3c4e-44b8-9ab5-18c3e350596f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:29:59.927087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84457c-3c4e-44b8-9ab5-18c3e350596f None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:29:59.927725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84457c-3c4e-44b8-9ab5-18c3e350596f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:29:59.929212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84457c-3c4e-44b8-9ab5-18c3e350596f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:29:59.937140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:29:59.937442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:29:59.938334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:29:59.939251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 257/515] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:29:59.939852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:29:59.957215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 259/516] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:29:59 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:29:59.958044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84457c-3c4e-44b8-9ab5-18c3e350596f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.053703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c050-d60f-41f7-810d-91dc2686f1f7 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.068249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84457c-3c4e-44b8-9ab5-18c3e350596f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.086339 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.093196 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a85fd-fbe2-4226-8f92-2367b2afbdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.093806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a85fd-fbe2-4226-8f92-2367b2afbdbe None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.094089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a85fd-fbe2-4226-8f92-2367b2afbdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.094361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a85fd-fbe2-4226-8f92-2367b2afbdbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.120245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.121132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.121341 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.121590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.130733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.133400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:00.148856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:00.149788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:00.150665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 260/517] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:00.151213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.175760 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a85fd-fbe2-4226-8f92-2367b2afbdbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.177242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a85fd-fbe2-4226-8f92-2367b2afbdbe None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.203647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.258880 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab5e00-da16-47dc-a9cf-28e2cd676f0b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.285004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 258/518] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:00.285973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a85fd-fbe2-4226-8f92-2367b2afbdbe None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.299745 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.300635 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.301127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.301546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.302456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:00.302906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.305139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.316758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.320061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 261/519] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:00.321033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.395421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a85fd-fbe2-4226-8f92-2367b2afbdbe None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.424854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77542df-d024-4b7e-a09a-f6a5b49d7898 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.430829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.431616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.432070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.432486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.433364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:00.433835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.435551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.439178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.454895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 259/520] 10.222.0.55 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:00.455708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.470262 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.471149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.471634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.471960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.472701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:00.473013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.474565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.492872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 262/521] 10.222.0.55 () {56 vars in 1139 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:00.493702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.557510 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.572212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280dcaf-8951-49ff-a495-78ae5d77fbe3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.594031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4b5df-fcb8-44d6-9028-9e75eb55d6c5 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.608285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.609062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.609444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.609813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.621207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.622796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.628534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.629167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.629450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.629722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.637043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.638487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:00.640305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:00.641384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:00.642402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:00.642402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:00.642402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:00.642585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 260/522] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:00.643324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:00.656299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:00.657152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 263/523] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:00.658160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.686768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.757465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a606d72-8c4c-4287-a6af-16330c7cbb56 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.766978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e96dbf-007e-4131-8952-384f0789ebb7 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:00.792789 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652575b-8c7e-44c0-ad06-3f0422ce80d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.793475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652575b-8c7e-44c0-ad06-3f0422ce80d0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.793841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652575b-8c7e-44c0-ad06-3f0422ce80d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.794121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652575b-8c7e-44c0-ad06-3f0422ce80d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.802626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd462da7-0f53-4454-92e4-d4d64963ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:00.803221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd462da7-0f53-4454-92e4-d4d64963ef55 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:00.804179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd462da7-0f53-4454-92e4-d4d64963ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:00.804460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd462da7-0f53-4454-92e4-d4d64963ef55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:00.805608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.865733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652575b-8c7e-44c0-ad06-3f0422ce80d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.867660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652575b-8c7e-44c0-ad06-3f0422ce80d0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.878236 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd462da7-0f53-4454-92e4-d4d64963ef55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:00.879696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd462da7-0f53-4454-92e4-d4d64963ef55 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:00.906468 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:00.975943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 261/524] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:00.975943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652575b-8c7e-44c0-ad06-3f0422ce80d0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:00.998715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 264/525] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:01.004247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd462da7-0f53-4454-92e4-d4d64963ef55 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.014907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.078683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652575b-8c7e-44c0-ad06-3f0422ce80d0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.112269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd462da7-0f53-4454-92e4-d4d64963ef55 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.118337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.119146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.119620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.119918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.120560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:01.120861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.122220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.138115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 262/526] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:01.138979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.139621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.148700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.149315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.149595 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.149871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.150569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:01.151159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.152377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.175515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 265/527] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:01.175515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.246456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.250136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da5c8-a7b0-407d-8721-1df85a60e565 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.278838 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f212f9-76f0-447f-8d9f-4fb83c204a1f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.287584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.288794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.289077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.289350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.300139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.301609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.314966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.315595 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:01.315715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:01.316697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:01.317529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:01.317529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:01.317529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:01.317776 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.317776 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.317906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 263/528] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:01.317906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.332005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.333485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:01.349372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:01.351040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:01.351935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:01.351935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:01.351935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:01.356012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 266/529] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:01.356868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.399670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.427522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c02d5-87c3-4bad-8813-863e3a1184f6 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.460666 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d94d5-342b-4651-8958-288dc20a7798 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.464927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.465564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.465843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.466117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.473214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.474926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:01.487621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:01.488632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:01.489476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 264/530] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:01.489937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.498875 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.499490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.499787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.500110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.500879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=9fbf473d168b4c9692f75a51c84b7db7) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:01.501195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.502688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.505367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.509962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 267/531] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/role_assignments?user.id=9fbf473d168b4c9692f75a51c84b7db7&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:01.510979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.622629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a13394-b1be-453f-aec2-16db78277510 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.661712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.661908 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a95c6-4aed-45f3-a399-96cf0c06c47f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.662724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.663190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.663606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.663803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.664572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:01.665100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.666670 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.679915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 265/532] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:01.680981 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.700033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.700663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.701200 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.701316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.701963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:01.702322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.703876 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.717134 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 268/533] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:01.718336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.756044 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.788022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15676cad-60fc-44f9-8360-a9f7601ecbff None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.824512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.825125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.825407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.825816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.826417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:01.826728 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.828238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.830374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713cc9-ec4e-42a7-b804-13917e0296f3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.846287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 266/534] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:01.847124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.866931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.867972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.868610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.869176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:01.876715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:01.878752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:01.891763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:01.892633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:01.893483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:01.893483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:01.893483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:01.893483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:01.893483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:01.893483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:01.893483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:01.893483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:01.895922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 269/535] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:01.896952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:01.926959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.959388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5468a-da4e-48ec-9e2d-2ecbe0b344c4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:01.990439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:01.996779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:01.997431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:01.997717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:01.997992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.004992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.006492 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:02.018013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:02.018866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:02.019750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:02.019750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:02.019750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:02.019750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:02.019750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:02.019750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:02.019750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:02.019750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:02.020209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61803ab-b74a-4686-a5dc-339bad696d8b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.020283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 267/536] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:02.020283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.056847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbed5e9-1090-4dbd-8b02-6070ba63264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.057860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbed5e9-1090-4dbd-8b02-6070ba63264e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.058145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbed5e9-1090-4dbd-8b02-6070ba63264e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.058419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbed5e9-1090-4dbd-8b02-6070ba63264e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.059140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbed5e9-1090-4dbd-8b02-6070ba63264e None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=df1a3f053649456d982dd6c2d45d23c3) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:02.059454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbed5e9-1090-4dbd-8b02-6070ba63264e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.061268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbed5e9-1090-4dbd-8b02-6070ba63264e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.073692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 270/537] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:01 2022] GET /identity/v3/role_assignments?user.id=df1a3f053649456d982dd6c2d45d23c3&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:02.073692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933388b4-2ecf-4906-a858-16db1c23342f None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.073692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933388b4-2ecf-4906-a858-16db1c23342f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.073692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933388b4-2ecf-4906-a858-16db1c23342f None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.073692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 271/538] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:02.073692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933388b4-2ecf-4906-a858-16db1c23342f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.172464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d09d6-a3a7-4e9a-835d-97f530dcaad4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.223319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ceb29-f1c7-4e07-9653-db1e50e426a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.223319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ceb29-f1c7-4e07-9653-db1e50e426a3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.223319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ceb29-f1c7-4e07-9653-db1e50e426a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.223808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ceb29-f1c7-4e07-9653-db1e50e426a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.224529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ceb29-f1c7-4e07-9653-db1e50e426a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:02.224840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ceb29-f1c7-4e07-9653-db1e50e426a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.226343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ceb29-f1c7-4e07-9653-db1e50e426a3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.238982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 268/539] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:02.245755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.245897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4f684-cdf5-4b56-ae3e-3b1d59b16145 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.245897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4f684-cdf5-4b56-ae3e-3b1d59b16145 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.245897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4f684-cdf5-4b56-ae3e-3b1d59b16145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.258641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933388b4-2ecf-4906-a858-16db1c23342f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.266542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c5c4f684-cdf5-4b56-ae3e-3b1d59b16145 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:02.268006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c5c4f684-cdf5-4b56-ae3e-3b1d59b16145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:02.295101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.295827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.296177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.296546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.297463 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:02.297836 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.299345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.312450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 272/540] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:02.313350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.334498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.363058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 269/541] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:02.364319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4f684-cdf5-4b56-ae3e-3b1d59b16145 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.474623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64e8e-d824-47c9-bdd1-a229972a93e9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.479443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4f684-cdf5-4b56-ae3e-3b1d59b16145 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.518765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.519374 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.519652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.519958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.521172 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=0319076e113748d4a86e5906559abdf5) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:02.522063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.527809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.540276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 270/542] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/role_assignments?user.id=0319076e113748d4a86e5906559abdf5&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:02.563565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.564237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.564517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.564794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.565549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=a9abba87fe6b44e5850d79dbd8d52469) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:02.565863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:02.567367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:02.575815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 273/543] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/role_assignments?user.id=a9abba87fe6b44e5850d79dbd8d52469&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:02.696642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.751342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.809830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4736f-bb37-44d1-8afc-87bd05e3392c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:02.845499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3ff5c-a9c2-4052-8c36-9edd9e48427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:02.846144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3ff5c-a9c2-4052-8c36-9edd9e48427a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:02.846427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3ff5c-a9c2-4052-8c36-9edd9e48427a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:02.846704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3ff5c-a9c2-4052-8c36-9edd9e48427a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:02.857814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3ff5c-a9c2-4052-8c36-9edd9e48427a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-30c3ff5c-a9c2-4052-8c36-9edd9e48427a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:02.863166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:02.864042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:02.864828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 271/544] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:02.870478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:02.896128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:02.989454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d95eb-44ca-44b8-ad99-2a586fceb6da None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:03.024325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:03.024861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.025142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.025415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.026079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:03.026380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.027797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.036328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 274/545] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:03.042338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3ff5c-a9c2-4052-8c36-9edd9e48427a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:03.149186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3ff5c-a9c2-4052-8c36-9edd9e48427a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:03.156435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:03.200494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:03.201141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.201410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.201686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.216793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.218273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:03.241653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:03.242620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:03.243477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:03.243477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:03.243477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:03.243477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 272/546] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:03.250038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:03.330193 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:03.359070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ec54c-1138-4711-b95b-ec8f55e89f92 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:03.410870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710c0fe-ab5a-40af-8ccc-3e470286db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:03.411497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c0fe-ab5a-40af-8ccc-3e470286db68 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.411802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c0fe-ab5a-40af-8ccc-3e470286db68 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.412080 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c0fe-ab5a-40af-8ccc-3e470286db68 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.412775 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c0fe-ab5a-40af-8ccc-3e470286db68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:03.413108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c0fe-ab5a-40af-8ccc-3e470286db68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.414519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c0fe-ab5a-40af-8ccc-3e470286db68 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.431630 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 275/547] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:03.437140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:03.582684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d38e-d094-473f-a001-9c831c82dff6 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:03.602242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745a23-ca04-4adf-87f5-78d0c0a90c18 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.602587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745a23-ca04-4adf-87f5-78d0c0a90c18 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.602869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745a23-ca04-4adf-87f5-78d0c0a90c18 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.604219 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 276/548] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:03.608954 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349565-7903-46f1-9092-85c56f8cafb5 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.609235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349565-7903-46f1-9092-85c56f8cafb5 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.609506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349565-7903-46f1-9092-85c56f8cafb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.636990 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-bf349565-7903-46f1-9092-85c56f8cafb5 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:03.638220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-bf349565-7903-46f1-9092-85c56f8cafb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:03.665489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:03.666470 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.667135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.668318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.681042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.682824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:03.695677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:03.697149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:03.698219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:03.700870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 273/549] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:03.706698 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:03.727264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:03.798057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 277/550] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:30:03.819156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3e87-f978-43b3-9610-5fc7d01c3e71 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:03.854504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:03.855428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:03.855962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:03.856475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:03.857467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:03.857978 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:03.859729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:03.878531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 274/551] 10.222.0.55 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:03.884451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf349565-7903-46f1-9092-85c56f8cafb5 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:03.955631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:03.996917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf349565-7903-46f1-9092-85c56f8cafb5 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.033149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f19c2-2839-40af-9b68-3c39e5b16d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.033778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f19c2-2839-40af-9b68-3c39e5b16d0f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.034062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f19c2-2839-40af-9b68-3c39e5b16d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.034340 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f19c2-2839-40af-9b68-3c39e5b16d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.104742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f19c2-2839-40af-9b68-3c39e5b16d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.106191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f19c2-2839-40af-9b68-3c39e5b16d0f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.169710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.212171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 278/552] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:04.217997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.281380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f19c2-2839-40af-9b68-3c39e5b16d0f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.349534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.399269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f19c2-2839-40af-9b68-3c39e5b16d0f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.416680 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54ef13-f4c8-4d2b-8ecc-60c7e05e25bc None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.458829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.460339 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.460770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.461585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.473044 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.474716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.480474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f93b1-a696-424e-b692-2bb3ce11b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.481128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f93b1-a696-424e-b692-2bb3ce11b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.481413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f93b1-a696-424e-b692-2bb3ce11b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.481690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f93b1-a696-424e-b692-2bb3ce11b7c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:04.491992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:04.493227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:04.494307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:04.494307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:04.494307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:04.496145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 275/553] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:04.501725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.520371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f93b1-a696-424e-b692-2bb3ce11b7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-c93f93b1-a696-424e-b692-2bb3ce11b7c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:04.527852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:04.528982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:04.529991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 279/554] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:04.536761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f93b1-a696-424e-b692-2bb3ce11b7c8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.582196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.627576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9fcbc-2dd6-4ebd-85a1-f6c240fbcc77 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.661034 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f93b1-a696-424e-b692-2bb3ce11b7c8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.664106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.674157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c347256-ac30-455b-9c71-dfa2dec67ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.675189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c347256-ac30-455b-9c71-dfa2dec67ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.675628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c347256-ac30-455b-9c71-dfa2dec67ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.676080 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c347256-ac30-455b-9c71-dfa2dec67ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.677012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c347256-ac30-455b-9c71-dfa2dec67ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:04.677855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c347256-ac30-455b-9c71-dfa2dec67ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.679904 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c347256-ac30-455b-9c71-dfa2dec67ec6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.701805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 276/555] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:04.701805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8440370-814c-44f9-b6c6-2a7aab316658 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.701805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8440370-814c-44f9-b6c6-2a7aab316658 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.701805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8440370-814c-44f9-b6c6-2a7aab316658 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.706228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abf44b-adb0-4a5f-8946-18f0872fadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.707099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 277/556] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:04.707406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf44b-adb0-4a5f-8946-18f0872fadbe None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.707925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8440370-814c-44f9-b6c6-2a7aab316658 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.708052 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf44b-adb0-4a5f-8946-18f0872fadbe None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.708617 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf44b-adb0-4a5f-8946-18f0872fadbe None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.709532 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abf44b-adb0-4a5f-8946-18f0872fadbe None admin] RBAC: Adding query filter params (name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:04.710662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abf44b-adb0-4a5f-8946-18f0872fadbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.713719 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abf44b-adb0-4a5f-8946-18f0872fadbe None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.725366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 280/557] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:04.727431 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b178e5-9b16-478e-b291-b90217e13091 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.727995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b178e5-9b16-478e-b291-b90217e13091 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.729158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b178e5-9b16-478e-b291-b90217e13091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.753091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-65b178e5-9b16-478e-b291-b90217e13091 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:04.755115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-65b178e5-9b16-478e-b291-b90217e13091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:04.819680 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8440370-814c-44f9-b6c6-2a7aab316658 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.843118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 281/558] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:04.844037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b178e5-9b16-478e-b291-b90217e13091 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.861170 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:04.864209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4db06-05e6-4e93-bc3a-da28bbe62888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:04.865091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4db06-05e6-4e93-bc3a-da28bbe62888 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.865609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4db06-05e6-4e93-bc3a-da28bbe62888 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.867045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4db06-05e6-4e93-bc3a-da28bbe62888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.876563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4db06-05e6-4e93-bc3a-da28bbe62888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:04.878553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4db06-05e6-4e93-bc3a-da28bbe62888 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d9e4db06-05e6-4e93-bc3a-da28bbe62888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:04.894073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:04.895174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:04.896300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:04.896300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:04.896300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:04.896300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:04.896300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:04.896300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:04.896300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:04.896300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:04.898809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 278/559] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:04.900225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f47ee2-e85a-4010-8984-6a9e7bb84f0e None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:04.900640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f47ee2-e85a-4010-8984-6a9e7bb84f0e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:04.901046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f47ee2-e85a-4010-8984-6a9e7bb84f0e None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:04.902813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 279/560] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:04.903808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f47ee2-e85a-4010-8984-6a9e7bb84f0e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:04.965935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b178e5-9b16-478e-b291-b90217e13091 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:04.968227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.010898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc933d72-5fb8-490a-b195-eb916bf234d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.012424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933d72-5fb8-490a-b195-eb916bf234d7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.012909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933d72-5fb8-490a-b195-eb916bf234d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.013488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933d72-5fb8-490a-b195-eb916bf234d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.027479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc933d72-5fb8-490a-b195-eb916bf234d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.029873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc933d72-5fb8-490a-b195-eb916bf234d7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.031058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f47ee2-e85a-4010-8984-6a9e7bb84f0e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-bc933d72-5fb8-490a-b195-eb916bf234d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:05.048909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:05.050130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:05.051172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:05.051172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:05.051172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:05.053184 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 282/561] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:05.055550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d3aa-a304-445f-9fad-3135a96c5be2 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.056015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d3aa-a304-445f-9fad-3135a96c5be2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.056438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d3aa-a304-445f-9fad-3135a96c5be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.071159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.072066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.072488 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.072859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.074057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:05.074057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.075705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.080087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-7ce6d3aa-a304-445f-9fad-3135a96c5be2 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:05.081457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7ce6d3aa-a304-445f-9fad-3135a96c5be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:05.094034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 280/562] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:05.095077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.153292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.159839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 283/563] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:05.160667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6d3aa-a304-445f-9fad-3135a96c5be2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.207757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d49ec-08eb-44a6-85cc-102e73be3687 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.217463 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.250285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.250641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.250919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.251558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:05.251907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.253257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.260179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6d3aa-a304-445f-9fad-3135a96c5be2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.268927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 281/564] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:05.268927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.298593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95351800-7906-4e66-9fbf-e8f92a339b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.299522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95351800-7906-4e66-9fbf-e8f92a339b3f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.299832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95351800-7906-4e66-9fbf-e8f92a339b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.300109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95351800-7906-4e66-9fbf-e8f92a339b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.300830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95351800-7906-4e66-9fbf-e8f92a339b3f None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=d0df2e3dd45c43c5a6f10c28479732b9) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:05.301130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95351800-7906-4e66-9fbf-e8f92a339b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.302567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95351800-7906-4e66-9fbf-e8f92a339b3f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.312086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 284/565] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/role_assignments?user.id=d0df2e3dd45c43c5a6f10c28479732b9&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:05.315226 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ba3c-f06f-4ff8-a3d3-c932fc4b9f2e None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.315597 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ba3c-f06f-4ff8-a3d3-c932fc4b9f2e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.316355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ba3c-f06f-4ff8-a3d3-c932fc4b9f2e None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.317647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 285/566] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:05.318740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1ba3c-f06f-4ff8-a3d3-c932fc4b9f2e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.391896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.405334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5c0e2-932f-4732-b10d-6a8088d8fe02 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.440343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1ba3c-f06f-4ff8-a3d3-c932fc4b9f2e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.447027 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a488ccb-901a-4b49-804e-284b979e078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.447027 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488ccb-901a-4b49-804e-284b979e078a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.447402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488ccb-901a-4b49-804e-284b979e078a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.447601 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488ccb-901a-4b49-804e-284b979e078a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.459228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a488ccb-901a-4b49-804e-284b979e078a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-9a488ccb-901a-4b49-804e-284b979e078a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:05.464113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:05.465225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:05.466093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 282/567] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:05.466877 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf002954-8e4d-422d-9380-ef7757588acc None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.467162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf002954-8e4d-422d-9380-ef7757588acc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.467436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf002954-8e4d-422d-9380-ef7757588acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.481226 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.482145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.482434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.482707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.485918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-bf002954-8e4d-422d-9380-ef7757588acc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:05.487113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bf002954-8e4d-422d-9380-ef7757588acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:05.492198 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.493714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:05.507910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:05.508856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:05.510245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 286/568] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:05.511000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.516556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.564033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 283/569] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:05.565051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf002954-8e4d-422d-9380-ef7757588acc None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.639922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f468a1-9ec0-4545-be23-2ddf220f60b3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.665537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.678186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf002954-8e4d-422d-9380-ef7757588acc None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.679588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbf26-f26f-4a4d-9cea-99d116159f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.680441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbf26-f26f-4a4d-9cea-99d116159f63 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.680798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbf26-f26f-4a4d-9cea-99d116159f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.681147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbf26-f26f-4a4d-9cea-99d116159f63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.692417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdbf26-f26f-4a4d-9cea-99d116159f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-3bbdbf26-f26f-4a4d-9cea-99d116159f63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:05.698207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:05.699129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:05.700207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 287/570] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:05.701814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbf26-f26f-4a4d-9cea-99d116159f63 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.721902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.722882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.723327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.723761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.724593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:05.725058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.727254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.736199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 284/571] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:05.737406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.759648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.810925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbf26-f26f-4a4d-9cea-99d116159f63 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.843310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24ee52-5193-4525-bc2f-53198a4f92da None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.847087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.847951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.848345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.848724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.849470 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:05.849783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.851906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.869353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 288/572] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:05.870153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.883140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:05.884049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:05.884554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:05.885134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:05.886108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:05.886611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:05.888284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:05.902560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 285/573] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:05.903815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:05.912235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:05.975572 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70bba-e2a9-41d7-b772-d027c980a518 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:05.995213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.013727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.014368 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.014633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.014911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.015032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330eda-d45d-416e-b794-0641594ceb6e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.026931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.028426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:06.044030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.044967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:06.045851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:06.045851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:06.045851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:06.045851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 289/574] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:06.046076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.053769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f966-8b8b-4d22-a490-ac995619442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.054456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f966-8b8b-4d22-a490-ac995619442d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.054740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f966-8b8b-4d22-a490-ac995619442d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.055015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f966-8b8b-4d22-a490-ac995619442d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.066682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550f966-8b8b-4d22-a490-ac995619442d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-b550f966-8b8b-4d22-a490-ac995619442d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:06.072622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.073534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:06.074387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 286/575] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:06.075831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f966-8b8b-4d22-a490-ac995619442d None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.148631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.158970 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec448-6afc-47ae-9361-9197f50acd14 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.186491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f966-8b8b-4d22-a490-ac995619442d None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.195079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.195715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.196026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.196303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.208920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.211443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.222409 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.223039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.223320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.223596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:06.226426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.227305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:06.228598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:06.228598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:06.228598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:06.228598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 290/576] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:06.228598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.240054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.241545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.243622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:06.257309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.263578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:06.264710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:06.264710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:06.264710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:06.264710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 287/577] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:06.264710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.344707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f05d9-b826-4b45-82f0-9a23a5948a35 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.368154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2cd10-35a9-4b00-a0e9-c2e79f016b38 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.379794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.380426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.380705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.381093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.382323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:06.382747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.384229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.402519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 291/578] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:06.402519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.403439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.409953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.410932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.411222 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.411501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.412529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:06.412875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.414258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.426822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 288/579] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:06.426822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.485553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.505028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f08a8-a425-4a65-8a14-6e0d24086e08 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.533386 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b612a4c-22d3-49f0-a4d9-bec7c2764848 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.540095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.540708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.540983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.541253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.541890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:06.542191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.543552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.559594 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 292/580] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:06.559594 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.574593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.575209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.575493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.575766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.576438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:06.576746 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.578108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.590361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 289/581] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:06.591055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.620017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.659013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867bccb-4a96-4af2-9044-514e1d490725 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.692420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.693047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.693336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.693603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.698434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b121d8-5dde-40dc-a442-66509a3e6076 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.701589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.703046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:06.714195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.715141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 293/582] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:06.716718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.719216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.742825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.743496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.743801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.744069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.754720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.756482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:06.773273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.774261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:06.775142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:06.775142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:06.775142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:06.775142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 290/583] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:06.775142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.829662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047049d-51a4-4732-9010-20430586ab86 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.856701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:06.868828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.869887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.870171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.870444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.877375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.878935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.882156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ea878-26c2-4194-9eff-fa18be936ae1 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:06.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.891988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:06.892874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 294/584] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:06.894050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.923965 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:06.924605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:06.924891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:06.925195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:06.934536 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:06.936030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:06.948332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:06.949257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:06.950189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:06.954249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 291/585] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:06.955124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:06.984789 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.005076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694166c-7f51-4125-876e-05555402f3fb None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.040070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.040681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.040954 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.041228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.041957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.042275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.043751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.062271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 295/586] 10.222.0.55 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.063152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.070182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d619f8-0606-40e2-9ca2-c0e90ed3f531 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.107047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.109270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.110144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.110896 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.111352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.112236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.112720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.114350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.126974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 292/587] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.128027 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.167436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdfca2-023b-4620-a7a5-27055244bbb1 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.202873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.203919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.204562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.204839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.205627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.205941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.207510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.217797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.226160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 296/588] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.226160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.236082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ccc0b-6cda-4be2-b3bc-7b405c0763c0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.269844 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.270524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.270654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.270927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.271660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.272529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.274213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.291488 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 293/589] 10.222.0.55 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.292490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.330027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394a5b3-dc97-4f43-9a6a-79d9a1ec55c1 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.331518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.364992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.365619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.365927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.366201 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.376492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.377956 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.388827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567ea7-e3c7-4c0e-9c67-aae0aa2ab1f3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:07.391767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:07.392724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:07.393618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:07.393618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:07.393618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:07.393618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 297/590] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:07.393618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.424863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83720c72-a54e-4d2e-8499-e16d66a29c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.425505 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83720c72-a54e-4d2e-8499-e16d66a29c84 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.425785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83720c72-a54e-4d2e-8499-e16d66a29c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.426088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83720c72-a54e-4d2e-8499-e16d66a29c84 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.432910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83720c72-a54e-4d2e-8499-e16d66a29c84 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.434337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83720c72-a54e-4d2e-8499-e16d66a29c84 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-83720c72-a54e-4d2e-8499-e16d66a29c84 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:07.446700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:07.447638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:07.448582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 294/591] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:07.449169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af11f9-55b9-46c9-b0ae-2fd3c517c192 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.449239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af11f9-55b9-46c9-b0ae-2fd3c517c192 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.449517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af11f9-55b9-46c9-b0ae-2fd3c517c192 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.450734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 295/592] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:07.451427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af11f9-55b9-46c9-b0ae-2fd3c517c192 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.460864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.496856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21081be0-ffd6-4ee9-9b57-0910a91ce79d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.530980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae75e6-6d4c-4691-a6d5-4214d0972892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.531578 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae75e6-6d4c-4691-a6d5-4214d0972892 None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.531894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae75e6-6d4c-4691-a6d5-4214d0972892 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.532172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae75e6-6d4c-4691-a6d5-4214d0972892 None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/9fbf473d168b4c9692f75a51c84b7db7/roles/c96f60a1a9284a17862e2507df5b15f0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.546076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae75e6-6d4c-4691-a6d5-4214d0972892 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=9fbf473d168b4c9692f75a51c84b7db7, role_id=c96f60a1a9284a17862e2507df5b15f0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.547521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae75e6-6d4c-4691-a6d5-4214d0972892 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.552111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af11f9-55b9-46c9-b0ae-2fd3c517c192 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.559638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 298/593] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:07 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/9fbf473d168b4c9692f75a51c84b7db7/roles/c96f60a1a9284a17862e2507df5b15f0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:07.575988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae75e6-6d4c-4691-a6d5-4214d0972892 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.575988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.591430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.592156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.592510 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.592751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.604676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.606177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:07.621974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:07.623006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:07.623900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:07.623900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:07.623900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:07.623900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 296/594] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:07.624142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.692521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.699727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae75e6-6d4c-4691-a6d5-4214d0972892 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.742054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f464fe-0651-4fd9-88aa-41905606df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.742297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac00f8-7b79-41bf-ac39-8e0739d34a23 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.742673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f464fe-0651-4fd9-88aa-41905606df60 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.742953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f464fe-0651-4fd9-88aa-41905606df60 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.743229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f464fe-0651-4fd9-88aa-41905606df60 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.744172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f464fe-0651-4fd9-88aa-41905606df60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.745351 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f464fe-0651-4fd9-88aa-41905606df60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.746744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f464fe-0651-4fd9-88aa-41905606df60 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.759499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 299/595] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.760745 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead30f0-dc70-4057-a4b4-c73f2d29e062 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.761032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead30f0-dc70-4057-a4b4-c73f2d29e062 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.761308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead30f0-dc70-4057-a4b4-c73f2d29e062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.780292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6ead30f0-dc70-4057-a4b4-c73f2d29e062 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:07.781530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6ead30f0-dc70-4057-a4b4-c73f2d29e062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:07.786882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.787501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.787830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.788119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.788858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.789172 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.790621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.813424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 297/596] 10.222.0.55 () {56 vars in 1139 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.813424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.848696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.859825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 300/597] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:07.859825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead30f0-dc70-4057-a4b4-c73f2d29e062 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:07.931728 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023afc9-fcdd-47d3-9e27-c47d161dacf0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:07.950178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:07.969486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f633-8735-4563-a385-963c33a9025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:07.970639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f633-8735-4563-a385-963c33a9025e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:07.970639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f633-8735-4563-a385-963c33a9025e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:07.970845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f633-8735-4563-a385-963c33a9025e None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:07.971452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f633-8735-4563-a385-963c33a9025e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:07.971855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f633-8735-4563-a385-963c33a9025e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:07.973378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f633-8735-4563-a385-963c33a9025e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:07.985726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 298/598] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:07.986781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f633-8735-4563-a385-963c33a9025e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.009402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead30f0-dc70-4057-a4b4-c73f2d29e062 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.053833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.054455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.054680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.054934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.064244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.066433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:08.082408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:08.083428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:08.084338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 301/599] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:08.085347 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.120370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f633-8735-4563-a385-963c33a9025e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.161497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:08.164911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.165846 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.166433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.166931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.181875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.183541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:08.203987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:08.205186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:08.206260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:08.206260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:08.206260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:08.208263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 299/600] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:08.209704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.217506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a2091-40b0-4467-b1c4-e3e80b09185a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.245729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:08.254019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.254655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.254935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.255206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.262049 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.263514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:08.275076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:08.275985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:08.276900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 302/601] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:08.278251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.329408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6348ab8-24cc-456a-8551-7cbc82320fe2 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.364493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.365097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.365377 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.366499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.367222 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:08.367533 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.368992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.385502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 300/602] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:08.385502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.385735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f45e2-a677-47d2-8cff-16abaf9a3b4d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.399989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:08.421682 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda524de-2027-4be4-b3a7-078c6c67cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.422317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda524de-2027-4be4-b3a7-078c6c67cb05 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.422598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda524de-2027-4be4-b3a7-078c6c67cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.422873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda524de-2027-4be4-b3a7-078c6c67cb05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.434536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda524de-2027-4be4-b3a7-078c6c67cb05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-eda524de-2027-4be4-b3a7-078c6c67cb05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:08.440060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:08.441019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:08.441845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 303/603] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:08.442538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda524de-2027-4be4-b3a7-078c6c67cb05 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.489152 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:08.504425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83d7df-93f3-4f5e-9567-e761b91cba6e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.541276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda524de-2027-4be4-b3a7-078c6c67cb05 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.542275 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.543004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.543388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.543675 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.544357 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:08.544662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.546030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.562976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 301/604] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:08.562976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.580241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.580839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.581123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.581394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.582077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:08.582380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.583845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.596169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 304/605] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:08.596952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.634021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:08.678919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d236c0f-69ac-42b5-b7f3-e4c3f05a6d33 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.705558 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b8ee2-64f3-4445-814a-a72b79e34eda None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.712869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76c91a-7517-4baa-bab8-8cd31e991f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.713526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c91a-7517-4baa-bab8-8cd31e991f2f None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.713806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c91a-7517-4baa-bab8-8cd31e991f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.714088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c91a-7517-4baa-bab8-8cd31e991f2f None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/df1a3f053649456d982dd6c2d45d23c3/roles/c96f60a1a9284a17862e2507df5b15f0` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.729855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76c91a-7517-4baa-bab8-8cd31e991f2f None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=df1a3f053649456d982dd6c2d45d23c3, role_id=c96f60a1a9284a17862e2507df5b15f0)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.731302 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76c91a-7517-4baa-bab8-8cd31e991f2f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.740322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:08.743207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.743919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.744272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.744623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.745358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:08.745740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.746577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 302/606] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:08 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/df1a3f053649456d982dd6c2d45d23c3/roles/c96f60a1a9284a17862e2507df5b15f0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:08.747509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76c91a-7517-4baa-bab8-8cd31e991f2f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.756926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.771182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 305/607] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:08.773191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.870214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76c91a-7517-4baa-bab8-8cd31e991f2f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.905852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:08.913631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bc58c-180d-4680-83d3-b65613efd0ef None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:08.916711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.917506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.917882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.918254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.925808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.927942 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:08.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:08.941148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:08.942221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:08.942221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:08.942221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:08.942221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:08.942221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:08.942221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:08.942221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:08.942221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:08.942718 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 303/608] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:08.943537 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:08.956352 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ab125-7097-4cde-83a4-0a2996c5243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:08.957043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ab125-7097-4cde-83a4-0a2996c5243d None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:08.957328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ab125-7097-4cde-83a4-0a2996c5243d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:08.957659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ab125-7097-4cde-83a4-0a2996c5243d None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/a9abba87fe6b44e5850d79dbd8d52469/roles/c96f60a1a9284a17862e2507df5b15f0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:08.976673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ab125-7097-4cde-83a4-0a2996c5243d None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=a9abba87fe6b44e5850d79dbd8d52469, role_id=c96f60a1a9284a17862e2507df5b15f0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:08.978162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ab125-7097-4cde-83a4-0a2996c5243d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:08.994636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 306/609] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:08 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/a9abba87fe6b44e5850d79dbd8d52469/roles/c96f60a1a9284a17862e2507df5b15f0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:09.000642 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ab125-7097-4cde-83a4-0a2996c5243d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.016244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:09.061843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167856f-8c54-4990-9423-5c9e2e6c0209 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.106509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.107346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.107731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.111809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.137216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.138631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:09.174207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:09.175234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:09.176138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:09.176138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:09.176138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:09.176138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 304/610] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:09.185278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ab125-7097-4cde-83a4-0a2996c5243d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.189426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.233494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.234155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.234438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.234714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.235425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:09.235734 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.237260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.250957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 307/611] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:09.257267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.288170 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:09.302630 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080a16d-9869-487e-9e47-c496628cf633 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.315710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:09.340787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.341444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.341673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.341939 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.342588 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:09.342891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.344302 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.356816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 305/612] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:09.368892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.376078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb8f48-b589-427b-aaf9-717d97e8c77f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.412536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362357a4-3f54-4517-82b2-565c0ee4881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.413592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362357a4-3f54-4517-82b2-565c0ee4881e None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.414056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362357a4-3f54-4517-82b2-565c0ee4881e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.414623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362357a4-3f54-4517-82b2-565c0ee4881e None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/0319076e113748d4a86e5906559abdf5/roles/c96f60a1a9284a17862e2507df5b15f0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.431092 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362357a4-3f54-4517-82b2-565c0ee4881e None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=0319076e113748d4a86e5906559abdf5, role_id=c96f60a1a9284a17862e2507df5b15f0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.433003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362357a4-3f54-4517-82b2-565c0ee4881e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.466499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 308/613] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:09 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/0319076e113748d4a86e5906559abdf5/roles/c96f60a1a9284a17862e2507df5b15f0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:09.511622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fb232-5ebb-40c9-a930-35fa40c79b1c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.553900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035261da-06dd-479e-8f0e-cd2feb61f498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.554555 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035261da-06dd-479e-8f0e-cd2feb61f498 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.554836 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035261da-06dd-479e-8f0e-cd2feb61f498 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.555110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035261da-06dd-479e-8f0e-cd2feb61f498 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.567674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035261da-06dd-479e-8f0e-cd2feb61f498 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.569883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035261da-06dd-479e-8f0e-cd2feb61f498 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-035261da-06dd-479e-8f0e-cd2feb61f498 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:09.584085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:09.585205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:09.586132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 306/614] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:09.591516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362357a4-3f54-4517-82b2-565c0ee4881e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.626427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba7ff-9014-49ff-ba51-8bd62cfe4e12 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.626755 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba7ff-9014-49ff-ba51-8bd62cfe4e12 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.627133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ba7ff-9014-49ff-ba51-8bd62cfe4e12 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.628832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 307/615] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:09.634837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bbe22-4b81-44be-b8a5-bfb15d941baf None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.634837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bbe22-4b81-44be-b8a5-bfb15d941baf None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.635292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bbe22-4b81-44be-b8a5-bfb15d941baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.654831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5b6bbe22-4b81-44be-b8a5-bfb15d941baf None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:09.656550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5b6bbe22-4b81-44be-b8a5-bfb15d941baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:09.680178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:09.682395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:09.740242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 308/616] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:30:09.749921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362357a4-3f54-4517-82b2-565c0ee4881e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.789148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.789907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.790295 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.790662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.791490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:09.791925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.793446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.812078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 309/617] 10.222.0.55 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:09.817669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bbe22-4b81-44be-b8a5-bfb15d941baf None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:09.921341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bbe22-4b81-44be-b8a5-bfb15d941baf None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:09.957343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:09.958064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:09.958442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:09.958814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:09.969638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:09.971221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:09.986503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:09.987604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:09.988822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:09.988822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:09.988822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:09.990132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 309/618] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:09.996300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.123560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06b21-8355-43b5-9c6c-fe233da6f464 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.160486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.167387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.169735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.170359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.170691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.171322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.172440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:10.172746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:10.174244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:10.186693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 310/619] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:10.192000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.196909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.302628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e389d9-0ffd-4d71-ac13-90a1f8fc67b9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.340586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.341835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.342266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.342687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.350377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:10.352394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:10.367437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:10.368592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:10.369695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:10.369695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:10.369695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:10.369695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:10.369695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:10.369695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:10.369695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:10.369695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:10.372240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 311/620] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:10.381081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.424952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f651b-a472-466b-9091-d42ecf1ba482 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.459812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.474659 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cecf5-11fa-4239-b271-56d27db18bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.475851 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cecf5-11fa-4239-b271-56d27db18bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.476149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cecf5-11fa-4239-b271-56d27db18bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.476405 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cecf5-11fa-4239-b271-56d27db18bd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.500736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cecf5-11fa-4239-b271-56d27db18bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-387cecf5-11fa-4239-b271-56d27db18bd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:10.506209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:10.507194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:10.508096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 310/621] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:10.522189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cecf5-11fa-4239-b271-56d27db18bd1 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.573250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5ea4-d253-49db-afea-dd56f2778a45 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.637836 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.638819 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.639281 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.639734 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.640467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.640892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:10.641401 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:10.643057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:10.655839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 312/622] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:10.668961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.685125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cecf5-11fa-4239-b271-56d27db18bd1 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.747181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.747815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.748102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.748376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.749049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:10.749457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:10.751049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:10.763908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 311/623] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:10.770719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:10.840205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:10.852302 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d769f6b-1fb5-4f02-b824-2aa294412b66 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.913402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773a98a-12af-4cba-b8b0-ca7016ccb73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:10.914074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a98a-12af-4cba-b8b0-ca7016ccb73f None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.914355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a98a-12af-4cba-b8b0-ca7016ccb73f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.914629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a98a-12af-4cba-b8b0-ca7016ccb73f None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/d0df2e3dd45c43c5a6f10c28479732b9/roles/c96f60a1a9284a17862e2507df5b15f0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.937686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a98a-12af-4cba-b8b0-ca7016ccb73f None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=d0df2e3dd45c43c5a6f10c28479732b9, role_id=c96f60a1a9284a17862e2507df5b15f0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:10.939569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a98a-12af-4cba-b8b0-ca7016ccb73f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:10.960240 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d31b6-315c-478f-9d95-7b3b27d2de79 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:10.960996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 313/624] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:10 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/d0df2e3dd45c43c5a6f10c28479732b9/roles/c96f60a1a9284a17862e2507df5b15f0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:10.963795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b769-aefa-4b3e-a38c-71d668f4c67a None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.964360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b769-aefa-4b3e-a38c-71d668f4c67a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.964857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84b769-aefa-4b3e-a38c-71d668f4c67a None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:10.971916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 314/625] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:10.973416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36404-172f-4292-8b06-45d08d3de71e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:10.973709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36404-172f-4292-8b06-45d08d3de71e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:10.973988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36404-172f-4292-8b06-45d08d3de71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.010195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-aef36404-172f-4292-8b06-45d08d3de71e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:11.011446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-aef36404-172f-4292-8b06-45d08d3de71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:11.031087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.031747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.032055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.032333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.035260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.047347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.048927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:11.076518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:11.077540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:11.079043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:11.079043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:11.079043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:11.079043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 312/626] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:11.083468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.113875 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 315/627] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:11.238735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39004c-8ec0-4801-80fb-997103e898e4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.275126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.276129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.276618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.277116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.277991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:11.278501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.280100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.292902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 313/628] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:11.298077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36404-172f-4292-8b06-45d08d3de71e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.382479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.409302 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36404-172f-4292-8b06-45d08d3de71e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.432131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.447125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535453a-931f-4661-ab9b-ccc4e36fe71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.447804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535453a-931f-4661-ab9b-ccc4e36fe71d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.448106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535453a-931f-4661-ab9b-ccc4e36fe71d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.448407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535453a-931f-4661-ab9b-ccc4e36fe71d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.456587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535453a-931f-4661-ab9b-ccc4e36fe71d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.458194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535453a-931f-4661-ab9b-ccc4e36fe71d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-6535453a-931f-4661-ab9b-ccc4e36fe71d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:11.471786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:11.472747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:11.473681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 316/629] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:11.474798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd11655-87f8-4340-9337-099f52b3a62e None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.474899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd11655-87f8-4340-9337-099f52b3a62e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.479411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd11655-87f8-4340-9337-099f52b3a62e None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.479411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 317/630] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:11.480454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd11655-87f8-4340-9337-099f52b3a62e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.489446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.560730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269109-5759-44f3-8a35-d99f80adc166 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.596283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd11655-87f8-4340-9337-099f52b3a62e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.604790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e8cb3-a95a-490b-b6ad-9a0fa953967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.605435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e8cb3-a95a-490b-b6ad-9a0fa953967d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.605721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e8cb3-a95a-490b-b6ad-9a0fa953967d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.606002 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e8cb3-a95a-490b-b6ad-9a0fa953967d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.621666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e8cb3-a95a-490b-b6ad-9a0fa953967d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-782e8cb3-a95a-490b-b6ad-9a0fa953967d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:11.626558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:11.628673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:11.630690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:11.635741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 314/631] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:11.635741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d38d8-d530-4797-a3cc-6cec2a6bde36 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.635741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d38d8-d530-4797-a3cc-6cec2a6bde36 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.635741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d38d8-d530-4797-a3cc-6cec2a6bde36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.639732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.640638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.641052 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.641459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.642482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:11.643759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.645430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.647444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.654193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-0d7d38d8-d530-4797-a3cc-6cec2a6bde36 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:11.655436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0d7d38d8-d530-4797-a3cc-6cec2a6bde36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:11.671510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 318/632] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:11.672683 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.739558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 315/633] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:11.741165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d38d8-d530-4797-a3cc-6cec2a6bde36 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.779375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:11.834604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a25c5-0a1d-4679-9ef2-ac7588e2f37f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.851527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d38d8-d530-4797-a3cc-6cec2a6bde36 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:11.889947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9530b-25a9-4eab-9f4f-595411dcd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.890489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9530b-25a9-4eab-9f4f-595411dcd16e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.890776 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9530b-25a9-4eab-9f4f-595411dcd16e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.891055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9530b-25a9-4eab-9f4f-595411dcd16e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.906989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60d8f-3695-475b-b2ea-1009e024ad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:11.907930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60d8f-3695-475b-b2ea-1009e024ad71 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.908395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60d8f-3695-475b-b2ea-1009e024ad71 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.908848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60d8f-3695-475b-b2ea-1009e024ad71 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.909720 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60d8f-3695-475b-b2ea-1009e024ad71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:11.910215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60d8f-3695-475b-b2ea-1009e024ad71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.911797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60d8f-3695-475b-b2ea-1009e024ad71 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.927913 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 319/634] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:11.930069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c09dc-cfb1-4d7e-bd4b-478f035e52ac None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:11.930574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c09dc-cfb1-4d7e-bd4b-478f035e52ac None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:11.931099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c09dc-cfb1-4d7e-bd4b-478f035e52ac None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:11.932965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 320/635] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:11.934008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c09dc-cfb1-4d7e-bd4b-478f035e52ac None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:11.972085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9530b-25a9-4eab-9f4f-595411dcd16e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:11.973659 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9530b-25a9-4eab-9f4f-595411dcd16e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:11.994567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.012985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.044199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c09dc-cfb1-4d7e-bd4b-478f035e52ac None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.082178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.082811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.083095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.083370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.084216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 316/636] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:12.087817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7f2b-4f24-404c-9859-781c8798ae8b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.087817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7f2b-4f24-404c-9859-781c8798ae8b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.087817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7f2b-4f24-404c-9859-781c8798ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.096987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.098444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.104125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5bbd7f2b-4f24-404c-9859-781c8798ae8b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:12.105316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5bbd7f2b-4f24-404c-9859-781c8798ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:12.113799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:12.114706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:12.116890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:12.116890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:12.116890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:12.116890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 321/637] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:12.116890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.182734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 317/638] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:12.183496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd7f2b-4f24-404c-9859-781c8798ae8b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.233717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7afdb-85a5-44df-9dc2-cae4c2df2f19 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.245420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.271087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.280075 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b1a79-33e4-4136-972f-45df98e35097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.281019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b1a79-33e4-4136-972f-45df98e35097 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.281503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b1a79-33e4-4136-972f-45df98e35097 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.281978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b1a79-33e4-4136-972f-45df98e35097 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.294504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b1a79-33e4-4136-972f-45df98e35097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-822b1a79-33e4-4136-972f-45df98e35097 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:12.299904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:12.301253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:12.302161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:12.310149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 322/639] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:12.311189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b1a79-33e4-4136-972f-45df98e35097 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.312293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd7f2b-4f24-404c-9859-781c8798ae8b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.359370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.360671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.361033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.361387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.375332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.376910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:12.392744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:12.393835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:12.395388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:12.395388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:12.395388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:12.399357 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 318/640] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:12.400310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.448371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b1a79-33e4-4136-972f-45df98e35097 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.485936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.486548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.486824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.487097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.487738 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:12.488072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.489440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.501564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 323/641] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:12.505700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.510852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5b2f1-2f09-42ba-aca0-27bb59b1e336 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.529203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.536147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.549245 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.549859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.550138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.550414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.551080 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:12.551389 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.552794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.561073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 319/642] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:12.561958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.618472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa8767-e282-4eb2-9981-a96ce82dffd8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.652688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.653304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.653598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.653877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.654823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:12.654823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.656255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.668857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 324/643] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:12.669661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.681839 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc89b5-4acb-4d8a-bccf-8b1bc7a647cb None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.717634 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3a84-e420-4632-8de4-17523aabcd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.718546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3a84-e420-4632-8de4-17523aabcd8d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.719018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3a84-e420-4632-8de4-17523aabcd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.719294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3a84-e420-4632-8de4-17523aabcd8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.729550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3a84-e420-4632-8de4-17523aabcd8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-4e7a3a84-e420-4632-8de4-17523aabcd8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:12.734849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:12.735874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 320/644] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:12.736749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3a84-e420-4632-8de4-17523aabcd8d None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.763176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.780338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741524b-25c1-4b23-9be5-1ff18b954d55 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.783876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:12.821151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.822055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.829016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.829601 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.848636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.850676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:12.869313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:12.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 15:30:12.871399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:12.872480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3a84-e420-4632-8de4-17523aabcd8d None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:12.878716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 325/645] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:12.879949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:12.922581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:12.923332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:12.923743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:12.925695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:12.942392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:12.944496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:12.967289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:12.968369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:12.969263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:12.969263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:12.969263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:12.974340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 321/646] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:12.974340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.040641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0b494-195b-47d4-952c-0f662947f039 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.086737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.087301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.087640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.087966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.095358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.095706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.097851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.107612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5054e5-dd03-4080-b6ff-df44913b4d53 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:13.111396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:13.112299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:13.113181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:13.113181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:13.113181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:13.113181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:13.113181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:13.113181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:13.113181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:13.113181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:13.116430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 326/647] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:13.117043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.129332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.154457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.155208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.155499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.155807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.156499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:13.156808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.158422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.167093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 322/648] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:13.168651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.244321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f5f3e-9e0f-4ee9-a62b-fca224266ebe None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.277594 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.278199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.278478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.278755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.279484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:13.279818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.281255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.281790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c2e5-34c8-4bc8-8501-431fef7a4118 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.297868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 327/649] 10.222.0.55 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:13.298837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.320612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.321221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.321507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.321782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.322427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:13.322733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.324127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.335494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 323/650] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:13.336307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.351305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.363805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.401886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92af80c-903c-4a2d-a23d-9dcb6ae42296 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.434962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a6b9b-6258-4775-a0ab-18b8472ffd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.435587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a6b9b-6258-4775-a0ab-18b8472ffd72 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.435906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a6b9b-6258-4775-a0ab-18b8472ffd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.436119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa82fb9-2573-44f8-9047-fe9be4f796ea None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.436216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a6b9b-6258-4775-a0ab-18b8472ffd72 None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.436859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a6b9b-6258-4775-a0ab-18b8472ffd72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:13.437165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a6b9b-6258-4775-a0ab-18b8472ffd72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.438606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a6b9b-6258-4775-a0ab-18b8472ffd72 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.450480 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 328/651] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:13.451632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1576a-4f23-4895-a0e9-345e1b49e302 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.451951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1576a-4f23-4895-a0e9-345e1b49e302 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.452231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1576a-4f23-4895-a0e9-345e1b49e302 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.453417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 329/652] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:13.454109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1576a-4f23-4895-a0e9-345e1b49e302 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.476828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.477465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.477744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.478012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.488107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.489551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:13.504325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:13.505354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:13.506330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:13.506330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:13.506330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:13.506330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 324/653] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:13.506330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.558997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1576a-4f23-4895-a0e9-345e1b49e302 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.571930 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.581912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.593207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f5498-fcce-41b9-a66f-984c78b97ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.593830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5498-fcce-41b9-a66f-984c78b97ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.594100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5498-fcce-41b9-a66f-984c78b97ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.594375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f5498-fcce-41b9-a66f-984c78b97ec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.607066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29902-b4b8-41fc-9202-a6f2d04d5348 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.639788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.640467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.640819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.641025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.648847 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.650285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.660012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5498-fcce-41b9-a66f-984c78b97ec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:13.661255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:13.662158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:13.663578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:13.664159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f5498-fcce-41b9-a66f-984c78b97ec2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.664239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 325/654] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:13.664239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.759854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 330/655] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:13.760530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cea03-b42f-42d2-9360-0f381d6a24f0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.761044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775e2f-9a41-4d99-8af8-da6fc80eb1fc None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.761337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775e2f-9a41-4d99-8af8-da6fc80eb1fc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.761617 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775e2f-9a41-4d99-8af8-da6fc80eb1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.778839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-35775e2f-9a41-4d99-8af8-da6fc80eb1fc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:13.780074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-35775e2f-9a41-4d99-8af8-da6fc80eb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:13.786257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.795918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.796526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.796804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.797075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.797660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:13.797851 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=9fbf473d168b4c9692f75a51c84b7db7) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:13.798321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.799644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:13.805842 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 326/656] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/role_assignments?user.id=9fbf473d168b4c9692f75a51c84b7db7&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:13.806612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.856406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 331/657] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:13.857622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775e2f-9a41-4d99-8af8-da6fc80eb1fc None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:13.939575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475eb2-cd6a-4713-a522-c538d63b3c0c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:13.994483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:13.995123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:13.995655 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:13.995989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:13.997126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:13.997126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:13.998477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.002784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775e2f-9a41-4d99-8af8-da6fc80eb1fc None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.012761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 327/658] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:14.013607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.044894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.045878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.046363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.046854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.048023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:14.048470 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.050004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.072992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 332/659] 10.222.0.55 () {56 vars in 1137 bytes} [Thu Sep 1 15:30:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:14.073204 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.073882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.095597 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.139259 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b72aa-d15f-4c15-85e3-0265dda0e4ed None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.177000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.177637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.177917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.178224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.188840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.190287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.193010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8f995-3244-4ec4-af83-8c6508d1165c None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:14.206348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:14.207317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:14.208243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:14.208243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:14.208243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:14.208243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 328/660] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:14.208479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.235400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.236853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.236853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.237188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.246465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.247960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:14.260855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:14.261850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:14.262837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 333/661] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:14.263455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.325781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646673aa-1efd-4a83-9984-e1372812c584 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.327303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.339961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.364376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afce43-2097-4958-bd84-83af7c65f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.364996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afce43-2097-4958-bd84-83af7c65f1dd None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.365278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afce43-2097-4958-bd84-83af7c65f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.365591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afce43-2097-4958-bd84-83af7c65f1dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.372019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9adbee-ee8e-4d4c-afe1-a6f00601120a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.410411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d618d6-cb15-4c20-a998-9dfe590630e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.411443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d618d6-cb15-4c20-a998-9dfe590630e0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.411726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d618d6-cb15-4c20-a998-9dfe590630e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.412029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d618d6-cb15-4c20-a998-9dfe590630e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.423749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d618d6-cb15-4c20-a998-9dfe590630e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a6d618d6-cb15-4c20-a998-9dfe590630e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:14.429118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:14.430055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:14.430920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 334/662] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:14.431636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d618d6-cb15-4c20-a998-9dfe590630e0 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.445831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afce43-2097-4958-bd84-83af7c65f1dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.447307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afce43-2097-4958-bd84-83af7c65f1dd None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.535231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d618d6-cb15-4c20-a998-9dfe590630e0 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.558769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 329/663] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:14.559610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afce43-2097-4958-bd84-83af7c65f1dd None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.562035 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.570509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.576754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.577420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.577707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.577979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.578624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:14.578932 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.580343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.596996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 335/664] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:14.596996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.671188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afce43-2097-4958-bd84-83af7c65f1dd None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.700360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf1b8c-d984-4bf4-9b8b-b52bc5dcdf27 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.708424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.709034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.709344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.709622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.710356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:14.710665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.712116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.735094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 330/665] 10.222.0.55 () {56 vars in 1139 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:14.735094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.738691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.739304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.739586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.739899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.741091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:14.741395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.742786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.751581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 336/666] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:14.752589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.802149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.810397 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:14.848500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f51ba-8125-4e1f-96bb-37475097e345 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.856612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6703-12d6-43fa-a378-ab32124fad05 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:14.885416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.886053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.886337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.886605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.891643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:14.892313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:14.892590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:14.892909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:14.896875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.898591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.900003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:14.901610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:14.913444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:14.919923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:14.920818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:14.920818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:14.920818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:14.920818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:14.920818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:14.920818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:14.920818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:14.920818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:14.921277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:14.922111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:14.923024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:14.923024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:14.923024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:14.923024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 331/667] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:14.923024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:14.923308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 337/668] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:14.923308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.028195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0566e2-0420-4762-8135-31517df83c64 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.034727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aef7ff-459e-42d0-b2d7-451150072efa None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.044636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.049522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.068199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.068850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.069069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.069343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.074703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0655d4-4a23-4369-b772-c6c691ba76c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.075309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0655d4-4a23-4369-b772-c6c691ba76c0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.075587 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0655d4-4a23-4369-b772-c6c691ba76c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.075891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0655d4-4a23-4369-b772-c6c691ba76c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.081050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.082534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:15.098254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:15.099212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:15.100650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:15.100650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:15.100650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:15.100650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 338/669] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:15.100650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.151853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0655d4-4a23-4369-b772-c6c691ba76c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.153320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0655d4-4a23-4369-b772-c6c691ba76c0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.204860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4464c7c-d1cc-4eb2-b2fd-a849c1b38c86 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.239604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.240235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.241076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.241346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.242049 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:15.242344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.243785 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.261071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 339/670] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:15.261071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.261804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 332/671] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:15.262650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0655d4-4a23-4369-b772-c6c691ba76c0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.278522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.292023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.369762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc0f67-6360-45b0-b3dc-cbb2f2cd9fda None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.375221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0655d4-4a23-4369-b772-c6c691ba76c0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.407977 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.409173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.409456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.409725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.410357 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:15.410659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.411476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.412052 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.412155 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.412994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.413273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.413914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:15.414215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.415622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.424428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 340/672] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:15.425256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.435922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 333/673] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:15.435922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.510231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.516337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.532913 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7807a-d89c-4060-9f98-a73c4da457aa None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.545541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a583e6-319a-4ca9-a08a-dfa98437678e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.569920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.570552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.570830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.571101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.580770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.581380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.581661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.581928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.582032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.582656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=df1a3f053649456d982dd6c2d45d23c3) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:15.582967 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.583373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.584936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.599868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 334/674] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/role_assignments?user.id=df1a3f053649456d982dd6c2d45d23c3&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:15.599868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:15.600698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:15.601660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:15.602581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:15.602581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:15.602581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:15.606716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 341/675] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:15.607680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.736285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd820de4-0bfe-4392-86e2-5905d7a95e3b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.737987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188cb4a-7e35-4caa-beba-b72068c36f46 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.782363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.783013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.783300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.783573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.785897 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.786764 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.787257 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.787759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.789925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.791323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.793489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.797089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.798529 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.800885 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:15.806925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:15.808077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:15.809014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:15.809014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:15.809014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:15.809014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:15.809014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:15.809014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:15.809014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:15.809014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:15.813645 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 335/676] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:15.814311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:15.817234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:15.818162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:15.819651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:15.820319 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 342/677] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:15.823805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:15.932868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe709e-c289-4959-b23a-cf8053d52044 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.941360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875c2f8-75c6-47d4-b12e-9ade73458641 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:15.971944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.972560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.972849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.973124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.973767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:15.974197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.975472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.979444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b696a-4673-4317-bc6a-830a71c0c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:15.980148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b696a-4673-4317-bc6a-830a71c0c7bb None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:15.980496 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b696a-4673-4317-bc6a-830a71c0c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:15.980837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b696a-4673-4317-bc6a-830a71c0c7bb None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:15.981594 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b696a-4673-4317-bc6a-830a71c0c7bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:15.981973 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b696a-4673-4317-bc6a-830a71c0c7bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:15.983978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b696a-4673-4317-bc6a-830a71c0c7bb None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:15.987162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 336/678] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:15.987971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.001619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 343/679] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:16.002793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858fe9-860a-464d-a842-87748b495136 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.003138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858fe9-860a-464d-a842-87748b495136 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.003477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47858fe9-860a-464d-a842-87748b495136 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.004907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 344/680] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:16.005528 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47858fe9-860a-464d-a842-87748b495136 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.062225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:16.068379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:16.111051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750dcd2-4c8a-4b23-8856-585b1cb8d3fe None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:16.115178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47858fe9-860a-464d-a842-87748b495136 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:16.148426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:16.149190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.149565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.149918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.150756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:16.151148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:16.153989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832629fa-539f-4ca6-8890-8edb46bdcef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:16.154128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:16.154217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832629fa-539f-4ca6-8890-8edb46bdcef0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.154217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832629fa-539f-4ca6-8890-8edb46bdcef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.154217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832629fa-539f-4ca6-8890-8edb46bdcef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.161758 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832629fa-539f-4ca6-8890-8edb46bdcef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:16.163405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832629fa-539f-4ca6-8890-8edb46bdcef0 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:16.175224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 337/681] 10.222.0.55 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:16.175224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-832629fa-539f-4ca6-8890-8edb46bdcef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:16.175752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:16.176832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:16.177869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 345/682] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:16.178905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a255-44b9-4b12-998e-eaf57a961013 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.178905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a255-44b9-4b12-998e-eaf57a961013 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.179164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a255-44b9-4b12-998e-eaf57a961013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.198552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-5820a255-44b9-4b12-998e-eaf57a961013 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:16.199853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5820a255-44b9-4b12-998e-eaf57a961013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:16.272981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 346/683] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:16.274243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820a255-44b9-4b12-998e-eaf57a961013 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.298585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de7db-f272-470f-a269-cef96879b8d5 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:16.315264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:16.341303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:16.341974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.342256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.342575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.343725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=a9abba87fe6b44e5850d79dbd8d52469) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:16.344089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:16.345815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:16.346197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:16.353448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 338/684] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:16 2022] GET /identity/v3/role_assignments?user.id=a9abba87fe6b44e5850d79dbd8d52469&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:16.354291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.447576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820a255-44b9-4b12-998e-eaf57a961013 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:16.522025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8c5d-7b13-4a6e-8a7e-6ceb483ff35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:16.522901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8c5d-7b13-4a6e-8a7e-6ceb483ff35d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.523234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8c5d-7b13-4a6e-8a7e-6ceb483ff35d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.523461 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8c5d-7b13-4a6e-8a7e-6ceb483ff35d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.550160 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96c819-2b94-45d7-b9b9-bbc98fa716ba None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:16.590656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:16.591270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.591550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.592114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.592577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:16.592885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:16.594321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:16.602879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8c5d-7b13-4a6e-8a7e-6ceb483ff35d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:16.604518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8c5d-7b13-4a6e-8a7e-6ceb483ff35d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:16.607600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 339/685] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:16.609276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.664877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:16.668061 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:16.728735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 347/686] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:16.729890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8c5d-7b13-4a6e-8a7e-6ceb483ff35d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.745989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f2838-1e46-48cd-8f6e-16a8a475cbd7 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:16.789524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d659a-7430-42a1-97c0-032270eee432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:16.790249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d659a-7430-42a1-97c0-032270eee432 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.790532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d659a-7430-42a1-97c0-032270eee432 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.790807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d659a-7430-42a1-97c0-032270eee432 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.806273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d659a-7430-42a1-97c0-032270eee432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-454d659a-7430-42a1-97c0-032270eee432 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:16.812515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:16.813731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:16.814771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:16.819148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 340/687] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:16.820038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d659a-7430-42a1-97c0-032270eee432 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.848969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8c5d-7b13-4a6e-8a7e-6ceb483ff35d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:16.884839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:16.885765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:16.886221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:16.886709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:16.887717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=0319076e113748d4a86e5906559abdf5) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:16.888223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:16.889840 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:16.903743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 348/688] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:16 2022] GET /identity/v3/role_assignments?user.id=0319076e113748d4a86e5906559abdf5&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:16.905046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:16.936765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:16.956211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:16.959093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d659a-7430-42a1-97c0-032270eee432 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.003317 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.004109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.004459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.004807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.018081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.020125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:17.039818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:17.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:17.041732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:17.041732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:17.041732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:17.041909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 341/689] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:17.050378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.124320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f94cd5-c5f8-4d72-905e-9748525a74b5 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.174152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.174507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.174744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.175016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.175690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:17.176036 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.177708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.190415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 349/690] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:17.196890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.198116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a8935-6639-4034-a9a4-3b6ddae64f47 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.236207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.237116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.237632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.238153 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.239040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:17.239543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.241177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.255300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 342/691] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:17.262107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.280884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:17.305266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:17.340463 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756dec5-2f87-487b-abba-ff4701ea2341 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.378744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7d687-f3ec-4cc6-b8d0-8dd2329e61ae None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.388481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.389764 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.390193 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.391019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.421616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.423106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.427106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.427960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.428344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.428718 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.436236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.437795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:17.450251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:17.451548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:17.452708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:17.452708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:17.452708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:17.452889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:17.453874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:17.454759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:17.454759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:17.454759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:17.454759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:17.454759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:17.454759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:17.454759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:17.454759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:17.455176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 350/693] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:17.455243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 343/693] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:17.458153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.462032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.590606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:17.651483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91326c-24eb-4fc0-aa0a-81ed42ba7c2c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.663494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1237-c564-4f43-9f4b-67fe81a0031c None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.703389 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:17.716900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574d433-bd25-4087-9ef8-57e697e1d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.717517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574d433-bd25-4087-9ef8-57e697e1d3df None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.717797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574d433-bd25-4087-9ef8-57e697e1d3df None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.718069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574d433-bd25-4087-9ef8-57e697e1d3df None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.718715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574d433-bd25-4087-9ef8-57e697e1d3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:17.719018 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574d433-bd25-4087-9ef8-57e697e1d3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.720434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574d433-bd25-4087-9ef8-57e697e1d3df None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.729396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6fd86-b5b0-4b00-9baa-ee98e7873261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.730028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6fd86-b5b0-4b00-9baa-ee98e7873261 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.730307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6fd86-b5b0-4b00-9baa-ee98e7873261 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.730579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6fd86-b5b0-4b00-9baa-ee98e7873261 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.731292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6fd86-b5b0-4b00-9baa-ee98e7873261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:17.731726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6fd86-b5b0-4b00-9baa-ee98e7873261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.733195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6fd86-b5b0-4b00-9baa-ee98e7873261 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.737729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 351/694] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:17.743934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3550-e326-417e-925d-53aebcd7ceda None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.744947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3550-e326-417e-925d-53aebcd7ceda None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.744947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3550-e326-417e-925d-53aebcd7ceda None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.745898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 352/695] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:17.746491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3550-e326-417e-925d-53aebcd7ceda None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.753394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 344/696] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:17.755421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd79b3-6254-4ee6-bc6f-00776648d6ec None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.755948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd79b3-6254-4ee6-bc6f-00776648d6ec None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.757065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd79b3-6254-4ee6-bc6f-00776648d6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.776307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-9ccd79b3-6254-4ee6-bc6f-00776648d6ec None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:17.777786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9ccd79b3-6254-4ee6-bc6f-00776648d6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:17.850389 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 345/697] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:17.851668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd79b3-6254-4ee6-bc6f-00776648d6ec None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:17.865104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3550-e326-417e-925d-53aebcd7ceda None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:17.925216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:17.926323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:17.926816 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:17.927287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:17.946162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:17.949477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:17.965201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:17.974084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:17.975920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:17.976851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:17.982396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 353/698] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:17.988843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.044938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd79b3-6254-4ee6-bc6f-00776648d6ec None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.089122 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.092765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.094175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.094453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.094722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.095466 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=d0df2e3dd45c43c5a6f10c28479732b9) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:18.095887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.097438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.112954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 346/699] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/role_assignments?user.id=d0df2e3dd45c43c5a6f10c28479732b9&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:18.140637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc540524-d11e-43e2-9752-e68acf9dea14 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.179075 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.179749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.180060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.180336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.181084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:18.181396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.182865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.183714 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.203508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 354/700] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:30:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:18.208865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.326586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a9e31-4a16-4425-82b7-2007755c32dd None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.338668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.398066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e51e78-efd4-4bc7-a6b8-347a6fff67ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.403265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51e78-efd4-4bc7-a6b8-347a6fff67ba None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.405626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51e78-efd4-4bc7-a6b8-347a6fff67ba None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.409576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e51e78-efd4-4bc7-a6b8-347a6fff67ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.440906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3ae26-19c1-4145-b3f6-d5682853de3a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.476664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.484111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e51e78-efd4-4bc7-a6b8-347a6fff67ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.485604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.485792 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e51e78-efd4-4bc7-a6b8-347a6fff67ba None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.486589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.487043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.487525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.502889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.505345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:18.534958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:18.536149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:18.537112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:18.537112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:18.537112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:18.540281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 347/701] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:18.549639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.631608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 355/702] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 15:30:18.637322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e51e78-efd4-4bc7-a6b8-347a6fff67ba None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.640820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.695030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14940ad9-1bc0-4bc0-bdbe-11a797a7ff7e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.765530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6b56-11ea-48b5-acb7-add2570a0782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.766913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6b56-11ea-48b5-acb7-add2570a0782 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.767439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6b56-11ea-48b5-acb7-add2570a0782 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.767906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6b56-11ea-48b5-acb7-add2570a0782 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.768705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6b56-11ea-48b5-acb7-add2570a0782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:18.769822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6b56-11ea-48b5-acb7-add2570a0782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.771337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6b56-11ea-48b5-acb7-add2570a0782 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.795159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 348/703] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:18.796802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a8e98-960f-4cf4-807b-f7aaea9d87f8 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.797291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a8e98-960f-4cf4-807b-f7aaea9d87f8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.797789 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a8e98-960f-4cf4-807b-f7aaea9d87f8 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.800080 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 349/704] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:18.800962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a8e98-960f-4cf4-807b-f7aaea9d87f8 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:18.823548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e51e78-efd4-4bc7-a6b8-347a6fff67ba None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:18.847713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:18.868935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4b6c-1a64-4c86-94f5-bf58281dfdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:18.869583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4b6c-1a64-4c86-94f5-bf58281dfdcf None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.869864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4b6c-1a64-4c86-94f5-bf58281dfdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.870138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4b6c-1a64-4c86-94f5-bf58281dfdcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.883809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4b6c-1a64-4c86-94f5-bf58281dfdcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:18.885191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4b6c-1a64-4c86-94f5-bf58281dfdcf None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-238e4b6c-1a64-4c86-94f5-bf58281dfdcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:18.902909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:18.904179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:18.905087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:18.905087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:18.905087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:18.910005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 356/705] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:18.911603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca9d4c-9242-41ae-a8e3-da44b542eddc None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:18.911922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca9d4c-9242-41ae-a8e3-da44b542eddc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:18.912735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca9d4c-9242-41ae-a8e3-da44b542eddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:18.934418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-2cca9d4c-9242-41ae-a8e3-da44b542eddc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:18.935266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2cca9d4c-9242-41ae-a8e3-da44b542eddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:18.958647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a8e98-960f-4cf4-807b-f7aaea9d87f8 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.001075 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.003977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5c984-bbe5-453d-b0ee-ea16351aeb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.007141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c984-bbe5-453d-b0ee-ea16351aeb3a None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.007753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c984-bbe5-453d-b0ee-ea16351aeb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.008301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c984-bbe5-453d-b0ee-ea16351aeb3a None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.009372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5c984-bbe5-453d-b0ee-ea16351aeb3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.012707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5c984-bbe5-453d-b0ee-ea16351aeb3a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.028072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 357/706] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:19.029176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca9d4c-9242-41ae-a8e3-da44b542eddc None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.053624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 350/707] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:30:18 2022] POST /identity/v3/users => generated 254 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:19.235644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca9d4c-9242-41ae-a8e3-da44b542eddc None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.301537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.302170 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.302454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.302730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.303413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:19.303716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.305149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.323234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 358/708] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:19.328441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5c984-bbe5-453d-b0ee-ea16351aeb3a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.384279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.448268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.455761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.461253 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5c984-bbe5-453d-b0ee-ea16351aeb3a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.498154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3eeb1-ac09-4103-a596-e9c14676f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.498712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3eeb1-ac09-4103-a596-e9c14676f63c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.498994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3eeb1-ac09-4103-a596-e9c14676f63c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.499267 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3eeb1-ac09-4103-a596-e9c14676f63c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.507736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3eeb1-ac09-4103-a596-e9c14676f63c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.509665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3eeb1-ac09-4103-a596-e9c14676f63c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.520391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7965b-eca4-4839-9818-97492a108313 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-e7d3eeb1-ac09-4103-a596-e9c14676f63c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:19.522887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:19.523858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:19.524808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 351/709] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:19.525763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d84590-b7ed-4a1d-af1b-5a01054415e9 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.525871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d84590-b7ed-4a1d-af1b-5a01054415e9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.526069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d84590-b7ed-4a1d-af1b-5a01054415e9 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.532133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 352/710] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:19.533139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d84590-b7ed-4a1d-af1b-5a01054415e9 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.572597 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17deeb1f-c344-45d1-a49b-ef26c2f5fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.573694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deeb1f-c344-45d1-a49b-ef26c2f5fca8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.574192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deeb1f-c344-45d1-a49b-ef26c2f5fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.574672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deeb1f-c344-45d1-a49b-ef26c2f5fca8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.575572 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deeb1f-c344-45d1-a49b-ef26c2f5fca8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.577370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deeb1f-c344-45d1-a49b-ef26c2f5fca8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-17deeb1f-c344-45d1-a49b-ef26c2f5fca8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:19.592290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:19.593471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:19.594342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:19.601745 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 359/711] 10.222.0.55 () {56 vars in 1129 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:19.603734 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8caa7-1300-453d-95db-f7efe00bb509 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.604249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8caa7-1300-453d-95db-f7efe00bb509 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.604741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8caa7-1300-453d-95db-f7efe00bb509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.625643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-8fb8caa7-1300-453d-95db-f7efe00bb509 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:19.627223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8fb8caa7-1300-453d-95db-f7efe00bb509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:19.694733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d84590-b7ed-4a1d-af1b-5a01054415e9 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.711463 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 360/712] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:19.712835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8caa7-1300-453d-95db-f7efe00bb509 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.760306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.783122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.783937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.792309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.792520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.793249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:19.793568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.795902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.827998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8caa7-1300-453d-95db-f7efe00bb509 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:19.831926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 353/713] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:19.838030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:19.877834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:19.897400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:19.898475 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:19.898475 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:19.899155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:19.900677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:19.901265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:19.903674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:19.914209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 361/714] 10.222.0.55 () {56 vars in 1124 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:19.921164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.110995 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40f16a-abe3-4142-915c-787fd286d458 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.158558 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f3a69-4516-41d7-86e2-49b2ad2e300f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.177189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.200947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.201572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.201845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.202110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.202853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=9fbf473d168b4c9692f75a51c84b7db7) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:20.203159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.205032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.213722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 354/715] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/role_assignments?user.id=9fbf473d168b4c9692f75a51c84b7db7&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=32319452053845419798d329f1c194d4 => generated 259 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.214713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.277289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.278581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.279083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.279576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.280493 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:20.281042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.283711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.308375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 362/716] 10.222.0.55 () {56 vars in 1124 bytes} [Thu Sep 1 15:30:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.408276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.418940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ec3d6-0a87-4339-acb9-6804b3dcb486 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.478565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.479203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.479482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.479759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] PATH_INFO: `/v3/services/network` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.480369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.481736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:20.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:20.494828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:20.495656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:20.499674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 355/717] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/services/network => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:20.501048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.611036 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1e1c1-cd78-4d52-a77b-854bce0cfe2c None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.647791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c66289-593d-4349-9910-05862d4586dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.651800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c66289-593d-4349-9910-05862d4586dc None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.651800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c66289-593d-4349-9910-05862d4586dc None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.651800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c66289-593d-4349-9910-05862d4586dc None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.651800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c66289-593d-4349-9910-05862d4586dc None admin] RBAC: Adding query filter params (name=network) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:20.651800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c66289-593d-4349-9910-05862d4586dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.651800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c66289-593d-4349-9910-05862d4586dc None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.663790 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 363/718] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.664071 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:20.766563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce9aed-9a53-4a84-ad24-a6d011b3cbab None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:20.800789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ee8b-ce81-4afd-80be-718c815a2713 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.801097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ee8b-ce81-4afd-80be-718c815a2713 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.801336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9ee8b-ce81-4afd-80be-718c815a2713 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.802810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 364/719] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:20.804391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:20.805565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.806075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.806871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.807634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3f1a3-3417-493e-968c-7c64b85f08c8 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:20.807967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3f1a3-3417-493e-968c-7c64b85f08c8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:20.808217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:20.808320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3f1a3-3417-493e-968c-7c64b85f08c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:20.808806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:20.810372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:20.817142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 356/720] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:20.845146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6bb3f1a3-3417-493e-968c-7c64b85f08c8 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:20.846377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6bb3f1a3-3417-493e-968c-7c64b85f08c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:20.876415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:20.922738 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 365/721] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:30:21.199361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.203549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:21.341603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396382a3-19be-41b5-9799-c40d9aa1a7a7 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.404754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfe0f3-ccb0-4f5c-9be6-efe7794586ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.405402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe0f3-ccb0-4f5c-9be6-efe7794586ee None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.405686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe0f3-ccb0-4f5c-9be6-efe7794586ee None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.405963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe0f3-ccb0-4f5c-9be6-efe7794586ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.428641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfe0f3-ccb0-4f5c-9be6-efe7794586ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-c0dfe0f3-ccb0-4f5c-9be6-efe7794586ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:21.433980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:21.434903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:21.435745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 357/722] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:21.442586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3f1a3-3417-493e-968c-7c64b85f08c8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.686245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3f1a3-3417-493e-968c-7c64b85f08c8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.701183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98608c-a8b0-43ce-98db-97e96e304d39 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.701466 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98608c-a8b0-43ce-98db-97e96e304d39 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.701734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98608c-a8b0-43ce-98db-97e96e304d39 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.706840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 358/723] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:21.708256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d530-7b85-49b2-bd89-8a06932911ac None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.708538 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d530-7b85-49b2-bd89-8a06932911ac None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.708929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d530-7b85-49b2-bd89-8a06932911ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.727486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-95d5d530-7b85-49b2-bd89-8a06932911ac None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:21.728725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-95d5d530-7b85-49b2-bd89-8a06932911ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:21.793821 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:21.801098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.801726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.801999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.802278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.802984 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:21.803292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:21.807876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 359/724] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 15:30:21.816847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:21.831512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 366/725] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:21.837159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5d530-7b85-49b2-bd89-8a06932911ac None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:21.943922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5d530-7b85-49b2-bd89-8a06932911ac None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:21.978504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:21.979139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:21.979420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:21.979693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:21.989786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:21.991417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:22.010622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:22.011575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:22.012515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:22.012515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:22.012515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:22.012515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 360/726] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:22.017657 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.045889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.160542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2afa63-ae05-439d-821e-0882c571d3f1 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.209620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.210459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.210902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.211335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.212147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:22.212612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.214123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.226344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 367/727] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:22.228111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.231297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.323890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.399360 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8814d-6f8a-4472-8c6e-5c63cc3e9f78 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.423873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.461820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e6178-f8a0-4025-86a0-3ea8c415b350 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.473311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160868-933b-496b-b9d6-961b9bb71fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.473953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160868-933b-496b-b9d6-961b9bb71fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.474230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160868-933b-496b-b9d6-961b9bb71fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.474498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a160868-933b-496b-b9d6-961b9bb71fa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.493268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a160868-933b-496b-b9d6-961b9bb71fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-9a160868-933b-496b-b9d6-961b9bb71fa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:22.506631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:22.507622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:22.508525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:22.509175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 361/728] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:22.516771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160868-933b-496b-b9d6-961b9bb71fa0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.524322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13d748-b99d-464a-b97c-4e3700549a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.524967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d748-b99d-464a-b97c-4e3700549a47 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.525246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d748-b99d-464a-b97c-4e3700549a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.525517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d748-b99d-464a-b97c-4e3700549a47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.536122 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13d748-b99d-464a-b97c-4e3700549a47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.538377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13d748-b99d-464a-b97c-4e3700549a47 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-bb13d748-b99d-464a-b97c-4e3700549a47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:22.554615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:22.555589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:22.556658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:22.559487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 368/729] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:22.560947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7c76-e744-49e1-874a-0f0dd1428c07 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.561876 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7c76-e744-49e1-874a-0f0dd1428c07 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.562373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7c76-e744-49e1-874a-0f0dd1428c07 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.568408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 369/730] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:22.569227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c7c76-e744-49e1-874a-0f0dd1428c07 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.652734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a160868-933b-496b-b9d6-961b9bb71fa0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.660414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.679024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c7c76-e744-49e1-874a-0f0dd1428c07 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.692023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406e9d-35c0-4668-9caf-8f32c81e7a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.692615 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406e9d-35c0-4668-9caf-8f32c81e7a26 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.692893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406e9d-35c0-4668-9caf-8f32c81e7a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.693166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406e9d-35c0-4668-9caf-8f32c81e7a26 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.693864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406e9d-35c0-4668-9caf-8f32c81e7a26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:22.694171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406e9d-35c0-4668-9caf-8f32c81e7a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.695535 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406e9d-35c0-4668-9caf-8f32c81e7a26 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.704324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 362/731] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:22.705476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c937c-9ade-442b-b467-243156ea0585 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.705756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c937c-9ade-442b-b467-243156ea0585 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.706028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c937c-9ade-442b-b467-243156ea0585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.720729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810f5cf-6947-402e-9c69-6d5341d63ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.721360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810f5cf-6947-402e-9c69-6d5341d63ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.721549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810f5cf-6947-402e-9c69-6d5341d63ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.721811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810f5cf-6947-402e-9c69-6d5341d63ed5 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.722545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810f5cf-6947-402e-9c69-6d5341d63ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:22.722852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810f5cf-6947-402e-9c69-6d5341d63ed5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.723911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-149c937c-9ade-442b-b467-243156ea0585 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:22.724323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810f5cf-6947-402e-9c69-6d5341d63ed5 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.725765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-149c937c-9ade-442b-b467-243156ea0585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:22.747540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 370/732] 10.222.0.55 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:22.747540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec228c8-9725-4281-a41e-f6cf416ee437 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.747540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec228c8-9725-4281-a41e-f6cf416ee437 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.747540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec228c8-9725-4281-a41e-f6cf416ee437 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.747540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 371/733] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:22.747540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec228c8-9725-4281-a41e-f6cf416ee437 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.750677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.806884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 363/734] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:22.807751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c937c-9ade-442b-b467-243156ea0585 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:22.861890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec228c8-9725-4281-a41e-f6cf416ee437 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.899632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741df3-6099-4afb-a667-bb6998d9ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.900685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741df3-6099-4afb-a667-bb6998d9ef37 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.901191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741df3-6099-4afb-a667-bb6998d9ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.901668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741df3-6099-4afb-a667-bb6998d9ef37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.913094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741df3-6099-4afb-a667-bb6998d9ef37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:22.914835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741df3-6099-4afb-a667-bb6998d9ef37 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:22.920589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:22.925219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c937c-9ade-442b-b467-243156ea0585 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-01741df3-6099-4afb-a667-bb6998d9ef37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:22.931561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:22.932783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:22.933669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:22.933669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:22.933669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:22.941055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 372/735] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:22.942212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4d1f-b9e7-4f55-8130-7e35c02d1a54 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.942494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4d1f-b9e7-4f55-8130-7e35c02d1a54 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.942769 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4d1f-b9e7-4f55-8130-7e35c02d1a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:22.967496 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4dfb4d1f-b9e7-4f55-8130-7e35c02d1a54 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:22.969057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4dfb4d1f-b9e7-4f55-8130-7e35c02d1a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:22.980855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e617c-102f-47f0-ac5e-6d5f826df182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:22.982178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e617c-102f-47f0-ac5e-6d5f826df182 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:22.982668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e617c-102f-47f0-ac5e-6d5f826df182 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:22.983472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e617c-102f-47f0-ac5e-6d5f826df182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.034393 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.059903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 373/736] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:23.061110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4d1f-b9e7-4f55-8130-7e35c02d1a54 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.088761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e617c-102f-47f0-ac5e-6d5f826df182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.090323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e617c-102f-47f0-ac5e-6d5f826df182 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.175700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4d1f-b9e7-4f55-8130-7e35c02d1a54 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.204623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.217524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 364/737] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 15:30:23.217524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e617c-102f-47f0-ac5e-6d5f826df182 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.222449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.223370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.223916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.224410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.225316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:23.225835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.227454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.239844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 374/738] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:23.241210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.294451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.321551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e617c-102f-47f0-ac5e-6d5f826df182 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.358737 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131eef4-faa2-463f-835e-2d711888038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.359650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131eef4-faa2-463f-835e-2d711888038f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.359958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131eef4-faa2-463f-835e-2d711888038f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.360227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131eef4-faa2-463f-835e-2d711888038f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.360706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7047-bd6e-4ca1-865c-f884f3cc69e3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.372067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131eef4-faa2-463f-835e-2d711888038f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d131eef4-faa2-463f-835e-2d711888038f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:23.376893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:23.379100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 365/739] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:23.380081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131eef4-faa2-463f-835e-2d711888038f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.405757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257c4d7-3e43-48fd-b50d-aca3403b24b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.406395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c4d7-3e43-48fd-b50d-aca3403b24b1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.406677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c4d7-3e43-48fd-b50d-aca3403b24b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.406950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257c4d7-3e43-48fd-b50d-aca3403b24b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.418305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257c4d7-3e43-48fd-b50d-aca3403b24b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.419802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257c4d7-3e43-48fd-b50d-aca3403b24b1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-2257c4d7-3e43-48fd-b50d-aca3403b24b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:23.437076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:23.438039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:23.438917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:23.438917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:23.438917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:23.438917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 375/740] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:23.439656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac2d2-6792-4cc2-80db-45023ab9b9c2 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.439656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac2d2-6792-4cc2-80db-45023ab9b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.440113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac2d2-6792-4cc2-80db-45023ab9b9c2 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.441521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 376/741] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:23.442062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ac2d2-6792-4cc2-80db-45023ab9b9c2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.457101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.503412 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131eef4-faa2-463f-835e-2d711888038f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.542145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.542791 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.543087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.543336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.551273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.553405 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:23.565985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:23.567103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:23.568127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 366/742] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:23.569407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.667017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.675564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ac2d2-6792-4cc2-80db-45023ab9b9c2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.681392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554124e-0334-4512-a862-30eaa302e947 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.701932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:23.716098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50b9d-c0f4-40d6-8bd6-c136895793f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.716839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50b9d-c0f4-40d6-8bd6-c136895793f8 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.717221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50b9d-c0f4-40d6-8bd6-c136895793f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.717567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50b9d-c0f4-40d6-8bd6-c136895793f8 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.718284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50b9d-c0f4-40d6-8bd6-c136895793f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.719242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.719806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50b9d-c0f4-40d6-8bd6-c136895793f8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.719920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.720145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.720414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.721075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:23.721381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.722725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.731852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 367/743] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:23.732785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.747829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 377/744] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:30:23 2022] POST /identity/v3/services => generated 251 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:23.747829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd291-4f8d-437f-9ee2-af25445f7dea None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.747829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd291-4f8d-437f-9ee2-af25445f7dea None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.747829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddd291-4f8d-437f-9ee2-af25445f7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.771158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-2eddd291-4f8d-437f-9ee2-af25445f7dea None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:23.773061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2eddd291-4f8d-437f-9ee2-af25445f7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:23.880117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63ca36-99f2-4049-b144-667e39c0995f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:23.907867 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 378/745] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 15:30:23.908081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd291-4f8d-437f-9ee2-af25445f7dea None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:23.937213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:23.937886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:23.938135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:23.938377 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:23.939026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:23.939328 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:23.942557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:23.961547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 368/746] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:23.962584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.017040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.064207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.094848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddd291-4f8d-437f-9ee2-af25445f7dea None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.135860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8436f-e809-4bf3-8c90-1d75a2b1ea22 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.165026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.165953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.167538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.168051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.168995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:24.170248 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.174727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.211083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.211721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.212251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.212532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.219435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 379/747] 10.222.0.55 () {56 vars in 1149 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:24.219435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.233263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.234875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:24.251169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:24.252191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:24.253106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:24.253106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:24.253106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:24.258188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 369/748] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:24.258188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.355941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ec1cd-86cd-4f94-be78-565eb45b45eb None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.369499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.380955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee442-ba6f-40b1-93b3-a5074a3b0bdf None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.393743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.394580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.395086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.395500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.403949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.405609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.408881 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:24.424584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:24.425526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:24.426454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:24.426454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:24.426454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:24.426454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:24.426454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:24.426454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:24.426454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:24.426454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:24.426886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f864d-69f0-4edb-b101-bfefe473e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.426886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f864d-69f0-4edb-b101-bfefe473e984 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.426886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f864d-69f0-4edb-b101-bfefe473e984 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.426886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f864d-69f0-4edb-b101-bfefe473e984 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.427155 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f864d-69f0-4edb-b101-bfefe473e984 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.427903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f864d-69f0-4edb-b101-bfefe473e984 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.428841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 380/749] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:24.434835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.447024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 370/750] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:30:24 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:24.448738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f864d-69f0-4edb-b101-bfefe473e984 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.677668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f864d-69f0-4edb-b101-bfefe473e984 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.679847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3099f-7f66-4046-b18e-95d2a7ff6d9a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:24.783115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.783989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.784273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.784869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.785679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:24.786063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:24.787492 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:24.791138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9de64-2c6b-49f0-8582-60f33c231439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:24.791945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9de64-2c6b-49f0-8582-60f33c231439 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:24.792400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9de64-2c6b-49f0-8582-60f33c231439 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:24.792863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9de64-2c6b-49f0-8582-60f33c231439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:24.806328 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 371/751] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:24.807396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:24.823249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:24.997141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.013371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9de64-2c6b-49f0-8582-60f33c231439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.023498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9de64-2c6b-49f0-8582-60f33c231439 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.186295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b694f93-7ea2-4137-b2c0-01ffe19ebaf5 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.231222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 381/752] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:30:25.232108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9de64-2c6b-49f0-8582-60f33c231439 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.273429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.274036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.274311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.274645 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.275342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:25.275654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.277122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.298163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 372/753] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:25.300383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.398331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.401590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9de64-2c6b-49f0-8582-60f33c231439 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.413557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.449874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.450927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.451208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.451631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.457406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f514d81-1c91-4a4b-a0d2-0e2b15733b83 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.461940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.463391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:25.477740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:25.478696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 382/754] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:25.480259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.498295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.499163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.499952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.500238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.516106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.517848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:25.542183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:25.543252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:25.545046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:25.545046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:25.545046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:25.545046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 373/755] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:25.545548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.619454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91a88-6f0a-4e00-af4b-9815fffded59 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.662137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c095773-73d2-47b4-b3a1-c7db1d633e5c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.668911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.670045 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.670330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.670612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.671821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=d0df2e3dd45c43c5a6f10c28479732b9) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:25.672145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.674276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.681874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 383/756] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/role_assignments?user.id=d0df2e3dd45c43c5a6f10c28479732b9&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=32319452053845419798d329f1c194d4 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:25.683246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.683909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.717612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:25.730540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be16416-8bf0-41f4-a416-d8a890113436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.731236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16416-8bf0-41f4-a416-d8a890113436 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.731568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16416-8bf0-41f4-a416-d8a890113436 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.731873 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16416-8bf0-41f4-a416-d8a890113436 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.732632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be16416-8bf0-41f4-a416-d8a890113436 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:25.732943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be16416-8bf0-41f4-a416-d8a890113436 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.734397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be16416-8bf0-41f4-a416-d8a890113436 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.776437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 374/757] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:25.777674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64d68d-1de6-4d79-80af-a7385727639e None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.777958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64d68d-1de6-4d79-80af-a7385727639e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.778234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64d68d-1de6-4d79-80af-a7385727639e None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.783749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 375/758] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:25.786814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64d68d-1de6-4d79-80af-a7385727639e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:25.816818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78674d2-c5ad-48ca-ade4-93211a826175 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.877238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1019e4-b841-49ed-ae1a-0dab1a6ecec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.877859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1019e4-b841-49ed-ae1a-0dab1a6ecec3 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.878141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1019e4-b841-49ed-ae1a-0dab1a6ecec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.878416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1019e4-b841-49ed-ae1a-0dab1a6ecec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.879067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1019e4-b841-49ed-ae1a-0dab1a6ecec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:25.879372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1019e4-b841-49ed-ae1a-0dab1a6ecec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.881370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1019e4-b841-49ed-ae1a-0dab1a6ecec3 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:25.899201 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 384/759] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:25.900518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09da8cb-a930-4293-a3c9-677aa408781c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.900807 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09da8cb-a930-4293-a3c9-677aa408781c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.901086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09da8cb-a930-4293-a3c9-677aa408781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.919445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f09da8cb-a930-4293-a3c9-677aa408781c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:25.920718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f09da8cb-a930-4293-a3c9-677aa408781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:25.922683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64d68d-1de6-4d79-80af-a7385727639e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:25.967056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:25.968255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:25.972106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:25.972666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:25.984076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:25.985994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:26.002263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:26.003261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:26.004223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:26.004223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:26.004223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:26.010576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 376/760] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:26.010576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.012370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 385/761] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:26.013223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09da8cb-a930-4293-a3c9-677aa408781c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.033284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.045860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.144064 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09da8cb-a930-4293-a3c9-677aa408781c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.167670 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba2a2-162c-4f79-96d1-a2372cc595ad None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.185862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.185862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.186149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.186579 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.187291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:26.187597 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.189173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.202681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 386/762] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.208853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.253476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.255946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.256570 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.257565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.271445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.277501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:26.294833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:26.295761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:26.296664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:26.296664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:26.296664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:26.296664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:26.296664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:26.296664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:26.296664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:26.296664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:26.304016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 377/763] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:26.312738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.344411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.366183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bb8e5-6aa1-45ee-aa68-987c813e5a49 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.401494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.402129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.402410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.402683 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.410803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.412792 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:26.426736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:26.428449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:26.429521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:26.429521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:26.429521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:26.429521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:26.429521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:26.429521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:26.429521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:26.429521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:26.435942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 387/764] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:26.435942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.463972 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.475656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e461e-1506-48b9-ad4e-11e4999c5ece None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.512715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.513559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.514015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.514551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.515528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:26.516010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.517769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.535980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 378/765] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.537692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.542036 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db3811-4aa0-40f7-8ffa-7d199a4a2ade None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.576967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.577524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.577806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.578082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.578669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.580097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.581955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:26.589935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:26.590948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:26.591842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 388/766] 10.222.0.55 () {56 vars in 1129 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:26.592678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.657280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef64bad-3b6c-452e-be85-6beb742eb68b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.690962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a9e76-6e02-415b-ba34-f636f8f61821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.691580 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a9e76-6e02-415b-ba34-f636f8f61821 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.691888 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a9e76-6e02-415b-ba34-f636f8f61821 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.692168 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a9e76-6e02-415b-ba34-f636f8f61821 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.692870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a9e76-6e02-415b-ba34-f636f8f61821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:26.693202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a9e76-6e02-415b-ba34-f636f8f61821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.694690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a9e76-6e02-415b-ba34-f636f8f61821 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.711829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 379/767] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.711829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb0ab-2500-4a3d-9389-8fd7d1803822 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.711829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb0ab-2500-4a3d-9389-8fd7d1803822 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.712125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d57d2-f683-444b-b95f-b3dfda910899 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.712226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb0ab-2500-4a3d-9389-8fd7d1803822 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.712226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 380/768] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:26.712226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb0ab-2500-4a3d-9389-8fd7d1803822 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.723308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.748890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.749507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.749786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.750056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.750781 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=7eaff7a61225436bb9e100b03f56441f) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:26.751090 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.752558 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.758118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 389/769] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/role_assignments?user.id=7eaff7a61225436bb9e100b03f56441f&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.758872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:26.834326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:26.861959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb0ab-2500-4a3d-9389-8fd7d1803822 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.886409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea2cc0-e6ce-4b95-992b-ae77d11d5e2c None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:26.917748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86644bd2-8193-43e7-9649-05c8415c4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.919276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86644bd2-8193-43e7-9649-05c8415c4d24 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.919276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86644bd2-8193-43e7-9649-05c8415c4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.919276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86644bd2-8193-43e7-9649-05c8415c4d24 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.919726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86644bd2-8193-43e7-9649-05c8415c4d24 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:26.920237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86644bd2-8193-43e7-9649-05c8415c4d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.921788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86644bd2-8193-43e7-9649-05c8415c4d24 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.927884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 381/770] 10.222.0.55 () {56 vars in 1124 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:26.929877 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c35ca-7d28-4a3a-bde9-27f992014b4c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.930520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c35ca-7d28-4a3a-bde9-27f992014b4c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.931009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c35ca-7d28-4a3a-bde9-27f992014b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.940639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753af97-298b-4bb5-b8e5-7185280c83d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:26.941307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753af97-298b-4bb5-b8e5-7185280c83d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:26.941582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753af97-298b-4bb5-b8e5-7185280c83d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:26.941852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753af97-298b-4bb5-b8e5-7185280c83d7 None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/9fbf473d168b4c9692f75a51c84b7db7/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:26.945244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753af97-298b-4bb5-b8e5-7185280c83d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=9fbf473d168b4c9692f75a51c84b7db7, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:26.946986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753af97-298b-4bb5-b8e5-7185280c83d7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:26.959914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-551c35ca-7d28-4a3a-bde9-27f992014b4c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:26.961151 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-551c35ca-7d28-4a3a-bde9-27f992014b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:26.980033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 390/771] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:26 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/9fbf473d168b4c9692f75a51c84b7db7/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:26.980033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753af97-298b-4bb5-b8e5-7185280c83d7 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:27.114036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 382/772] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:27.188685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753af97-298b-4bb5-b8e5-7185280c83d7 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.214024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.228609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.229231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.229512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.229792 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.230437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:27.230943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:27.232395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:27.237664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 391/773] 10.222.0.55 () {56 vars in 1124 bytes} [Thu Sep 1 15:30:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:27.243596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c35ca-7d28-4a3a-bde9-27f992014b4c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:27.252649 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.394994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c35ca-7d28-4a3a-bde9-27f992014b4c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.451798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:27.467758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.468404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.468688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.468963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.469677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] RBAC: Adding query filter params (interface=public, service_id=d285d21342bb41559255e375f05674b6, region_id=RegionOne) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:27.469996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:27.471426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:27.485494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 383/774] 10.222.0.55 () {56 vars in 1251 bytes} [Thu Sep 1 15:30:27 2022] GET /identity/v3/endpoints?service_id=d285d21342bb41559255e375f05674b6&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:27.490983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:27.612148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.634230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd2d9-81d4-4e78-ae6b-7ed40d19b611 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.674918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c32e3-26bb-443f-984a-3df8d91eaf7a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.696809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.697456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.697735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.698009 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] PATH_INFO: `/v3/services/network` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.698600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:27.700014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:27.719502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:27.720546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:27.722182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 392/775] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:27 2022] GET /identity/v3/services/network => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:27.728709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:27.747310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645cce6-ba46-422e-b644-b9f43b77272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.747971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645cce6-ba46-422e-b644-b9f43b77272b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.748257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645cce6-ba46-422e-b644-b9f43b77272b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.748535 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645cce6-ba46-422e-b644-b9f43b77272b None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.749150 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645cce6-ba46-422e-b644-b9f43b77272b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:27.750587 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645cce6-ba46-422e-b644-b9f43b77272b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:27.761447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 384/776] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:30:27 2022] GET /identity/v3/services => generated 772 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:27.762719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634f47-e253-4184-aac2-4816a5bb784b None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.763005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634f47-e253-4184-aac2-4816a5bb784b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.763285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634f47-e253-4184-aac2-4816a5bb784b None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.766045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 385/777] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:27.776221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156eb9-476a-4559-8cc3-2de359a490a0 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.776477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156eb9-476a-4559-8cc3-2de359a490a0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.776747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156eb9-476a-4559-8cc3-2de359a490a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.813321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-75156eb9-476a-4559-8cc3-2de359a490a0 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:27.814539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-75156eb9-476a-4559-8cc3-2de359a490a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:27.843830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:27.956606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee69dd-26f2-41a9-bab3-70a9c0fdc917 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:27.966396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 386/778] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:27.996242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:27.996855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:27.997134 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:27.997407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:27.998039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] RBAC: Adding query filter params (name=network) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:27.998341 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:27.999809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.006649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 393/779] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:28.012130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156eb9-476a-4559-8cc3-2de359a490a0 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.075968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:28.114430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156eb9-476a-4559-8cc3-2de359a490a0 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.151483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.152133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.152417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.152694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.153345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:28.153654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:28.155034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.160247 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 387/780] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:28.168873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.260575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.347297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec537fc2-7844-41af-b3d7-803597279787 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.370682 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:28.387263 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.387967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.388254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.388533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.389306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] RBAC: Adding query filter params (interface=public, service_id=96c83a6d4f604881bd43a9f9486f1f03, region_id=RegionOne) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:28.389619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:28.391744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.401813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 394/781] 10.222.0.55 () {56 vars in 1251 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/endpoints?service_id=96c83a6d4f604881bd43a9f9486f1f03&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:28.407458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.525981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613d210-f9ab-4e39-a8fb-d49e6f3f8bcc None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.571975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff0395-8a57-48c3-8144-e29c244e8c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.571975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff0395-8a57-48c3-8144-e29c244e8c35 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.571975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff0395-8a57-48c3-8144-e29c244e8c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.573110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff0395-8a57-48c3-8144-e29c244e8c35 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.575801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff0395-8a57-48c3-8144-e29c244e8c35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:28.579795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff0395-8a57-48c3-8144-e29c244e8c35 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.587445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293b7ab-f77f-4196-b052-fd1f21819de2 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.592862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 395/782] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:28.621168 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:28.632785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401cdbd-5c9d-4dce-af6e-fbb90deb9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.633454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401cdbd-5c9d-4dce-af6e-fbb90deb9de7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.633730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401cdbd-5c9d-4dce-af6e-fbb90deb9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.633999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401cdbd-5c9d-4dce-af6e-fbb90deb9de7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.645087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401cdbd-5c9d-4dce-af6e-fbb90deb9de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-8401cdbd-5c9d-4dce-af6e-fbb90deb9de7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:28.651104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:28.652130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:28.652985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 388/783] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:28.658217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff0395-8a57-48c3-8144-e29c244e8c35 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.754196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:28.833807 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff0395-8a57-48c3-8144-e29c244e8c35 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:28.878624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d2250-2cd3-47fd-8ed0-fe71915a9de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:28.879267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2250-2cd3-47fd-8ed0-fe71915a9de2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.879516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2250-2cd3-47fd-8ed0-fe71915a9de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.879809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d2250-2cd3-47fd-8ed0-fe71915a9de2 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.880491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d2250-2cd3-47fd-8ed0-fe71915a9de2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:28.882762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d2250-2cd3-47fd-8ed0-fe71915a9de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:28.882873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d2250-2cd3-47fd-8ed0-fe71915a9de2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:28.891981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 396/784] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:28.897573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401cdbd-5c9d-4dce-af6e-fbb90deb9de7 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:28.912410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473709b7-b274-45d9-b437-3d73a2365ac3 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.912754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473709b7-b274-45d9-b437-3d73a2365ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.912991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473709b7-b274-45d9-b437-3d73a2365ac3 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.914559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 397/785] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:28.921850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1f274-1699-4f91-bbb4-496489df8a4a None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:28.922159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1f274-1699-4f91-bbb4-496489df8a4a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:28.922405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1f274-1699-4f91-bbb4-496489df8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:28.944205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ddd1f274-1699-4f91-bbb4-496489df8a4a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:28.945436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ddd1f274-1699-4f91-bbb4-496489df8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:29.032339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 398/786] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:29.140676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401cdbd-5c9d-4dce-af6e-fbb90deb9de7 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.183622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44249f4-a46f-4983-b074-50b7601f446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.184698 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44249f4-a46f-4983-b074-50b7601f446a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.185200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44249f4-a46f-4983-b074-50b7601f446a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.185689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44249f4-a46f-4983-b074-50b7601f446a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.206116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44249f4-a46f-4983-b074-50b7601f446a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.207902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44249f4-a46f-4983-b074-50b7601f446a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d44249f4-a46f-4983-b074-50b7601f446a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:29.223563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:29.225154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:29.226051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:29.226051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:29.226051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:29.228187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 389/787] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:29.236875 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1f274-1699-4f91-bbb4-496489df8a4a None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.297680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.370203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca00b-c1a7-4830-aa60-6da24ceb500c None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.370833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca00b-c1a7-4830-aa60-6da24ceb500c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.371315 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ca00b-c1a7-4830-aa60-6da24ceb500c None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.376435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 390/788] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:29.380145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b194bc-4cf0-4fd8-8e4b-e6aca429db82 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.380781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b194bc-4cf0-4fd8-8e4b-e6aca429db82 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.381269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b194bc-4cf0-4fd8-8e4b-e6aca429db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.403923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-87b194bc-4cf0-4fd8-8e4b-e6aca429db82 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:29.405422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-87b194bc-4cf0-4fd8-8e4b-e6aca429db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:29.420778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1f274-1699-4f91-bbb4-496489df8a4a None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.440289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.456910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.457652 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.457790 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.458071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.458757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:29.459072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.460592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.472658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 399/789] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:29.473526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.487608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 391/790] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:29.488980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b194bc-4cf0-4fd8-8e4b-e6aca429db82 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.606872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b194bc-4cf0-4fd8-8e4b-e6aca429db82 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.638232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.645341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.646786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.647583 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.648897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.656795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.658610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.670169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91802c7-a36e-4224-9e6b-3d70137b9420 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:29.672983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:29.673983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:29.674912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:29.677618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 392/791] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:29.687209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.719279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.781245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad34ddf-47c9-4b9a-bf80-544dc3447d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.782018 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad34ddf-47c9-4b9a-bf80-544dc3447d70 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.782286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad34ddf-47c9-4b9a-bf80-544dc3447d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.782561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad34ddf-47c9-4b9a-bf80-544dc3447d70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.794158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad34ddf-47c9-4b9a-bf80-544dc3447d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-dad34ddf-47c9-4b9a-bf80-544dc3447d70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:29.800530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:29.801526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 400/792] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:29.802962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad34ddf-47c9-4b9a-bf80-544dc3447d70 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.806233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509d1d-a4a6-4373-b69d-08cf3efd0966 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.845380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.846222 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.846642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.847084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.847982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:29.848430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:29.851045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:29.870225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 393/793] 10.222.0.55 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:29.871363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:29.928868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad34ddf-47c9-4b9a-bf80-544dc3447d70 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.970147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:29.981041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54123d0a-4a18-49ee-8c2b-863d6ddff2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:29.981980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54123d0a-4a18-49ee-8c2b-863d6ddff2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:29.982354 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54123d0a-4a18-49ee-8c2b-863d6ddff2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:29.982979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54123d0a-4a18-49ee-8c2b-863d6ddff2f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:29.988507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bdcba-8a27-4364-932a-bb71851946d2 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:29.999692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54123d0a-4a18-49ee-8c2b-863d6ddff2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-54123d0a-4a18-49ee-8c2b-863d6ddff2f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:30.006709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:30.007607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:30.008472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 401/794] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:30.009145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54123d0a-4a18-49ee-8c2b-863d6ddff2f2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.032322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.032938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.033219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.033501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.034408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.035540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.036100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.038001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.049800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 394/795] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.051914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.139115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54123d0a-4a18-49ee-8c2b-863d6ddff2f2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.161326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbcf9c-8e84-4a33-8e89-f16990130c15 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.180772 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.181420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.181769 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.182109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.193534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.195063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.199086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb54da-465f-4d06-9bfd-9cbd02a2ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.199883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb54da-465f-4d06-9bfd-9cbd02a2ffcb None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.200313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb54da-465f-4d06-9bfd-9cbd02a2ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.200752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb54da-465f-4d06-9bfd-9cbd02a2ffcb None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.201573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb54da-465f-4d06-9bfd-9cbd02a2ffcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.202036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb54da-465f-4d06-9bfd-9cbd02a2ffcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.203398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb54da-465f-4d06-9bfd-9cbd02a2ffcb None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:30.210560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:30.211488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:30.212949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:30.212949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:30.212949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:30.216111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 402/796] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:30.216659 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 395/797] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.217542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.217951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e4cf1-01a3-4544-902a-784f4cefa6b6 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.218199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e4cf1-01a3-4544-902a-784f4cefa6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.218477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e4cf1-01a3-4544-902a-784f4cefa6b6 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.219901 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 396/798] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:30.224067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e4cf1-01a3-4544-902a-784f4cefa6b6 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.233165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.290464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.329348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648825d-c046-4928-b249-54bc63b86d1f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.335125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e4cf1-01a3-4544-902a-784f4cefa6b6 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.372089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.372317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41091a-aebe-4d4e-8a68-500842308632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.372706 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.372991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.373256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41091a-aebe-4d4e-8a68-500842308632 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.373345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.373693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41091a-aebe-4d4e-8a68-500842308632 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.373902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.374144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41091a-aebe-4d4e-8a68-500842308632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.374236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.375565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.385837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41091a-aebe-4d4e-8a68-500842308632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.387397 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41091a-aebe-4d4e-8a68-500842308632 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.392929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 397/799] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.392929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-ca41091a-aebe-4d4e-8a68-500842308632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:30.403857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:30.409812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:30.410958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:30.410958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:30.410958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:30.410958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 403/800] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:30.410958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e69c1-3c48-4b88-96db-688cf819fbcc None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.410958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e69c1-3c48-4b88-96db-688cf819fbcc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.410958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e69c1-3c48-4b88-96db-688cf819fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.426584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-409e69c1-3c48-4b88-96db-688cf819fbcc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:30.428146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-409e69c1-3c48-4b88-96db-688cf819fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:30.468995 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.501472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 404/801] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:30.502542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e69c1-3c48-4b88-96db-688cf819fbcc None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.517927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea58d6-20ab-4762-8448-8b348b866d03 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.554563 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.567479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.568220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.568990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.569262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.585646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.587119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:30.602270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:30.603239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:30.604195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:30.604195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:30.604195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:30.608192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 398/802] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:30.609084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.625626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e69c1-3c48-4b88-96db-688cf819fbcc None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.675909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.676551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.676832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.677106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.687638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.690783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:30.704996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:30.705922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:30.706822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 405/803] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:30.707309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.725046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260bd3c-a927-47ba-aca6-53ea351bde00 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.749985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.763392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.764095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.764380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.764693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.765352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.765660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.767040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.783852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 399/804] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.785348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.841872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad45a6d-fc9b-46f3-b9b6-6784e25f43a1 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.854439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:30.884893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.885501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.885783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.886055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.886689 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.886991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.888398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.890113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e201-6300-46c1-a3e8-857f1cac4e3b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:30.902132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 406/805] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.903157 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.931576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:30.932248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:30.932529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:30.932805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:30.933506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:30.933863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:30.935329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:30.947058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 400/806] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:30.947879 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:30.999201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.020180 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796a87-98aa-44cf-8051-9411c9838ec7 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.054135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.054759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.055038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.055312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.055922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.057294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.057603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3198d2e-a40b-4c74-bb33-5a1db16bf1fb None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:31.066087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:31.067259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:31.068208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 407/807] 10.222.0.55 () {56 vars in 1129 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:31.069021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.095004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.095632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.095953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.096231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.100370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.104318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.105755 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:31.116952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:31.118164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:31.119384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:31.122923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 401/808] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:30:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:31.123674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.172879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceabfa-54e3-4f67-ab1f-fa21c1bafe53 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.205266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0599c0-08f6-4046-9302-99f67a7687a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.205897 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0599c0-08f6-4046-9302-99f67a7687a8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.206181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0599c0-08f6-4046-9302-99f67a7687a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.206453 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0599c0-08f6-4046-9302-99f67a7687a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.214195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0599c0-08f6-4046-9302-99f67a7687a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.215629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0599c0-08f6-4046-9302-99f67a7687a8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.221060 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b9db-d4d4-4603-be3b-7b1e04b39249 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.225822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-2a0599c0-08f6-4046-9302-99f67a7687a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:31.227460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:31.228593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:31.229534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 408/809] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:31.230122 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92627168-1d5f-4c1b-80fe-dcee4075bfe1 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.230122 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92627168-1d5f-4c1b-80fe-dcee4075bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.230502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92627168-1d5f-4c1b-80fe-dcee4075bfe1 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.231544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 409/810] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:31.232251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92627168-1d5f-4c1b-80fe-dcee4075bfe1 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.264042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45015f-024b-482b-97b9-2f05799d6573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.264638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45015f-024b-482b-97b9-2f05799d6573 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.264940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45015f-024b-482b-97b9-2f05799d6573 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.265204 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45015f-024b-482b-97b9-2f05799d6573 None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/d0df2e3dd45c43c5a6f10c28479732b9/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.267136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45015f-024b-482b-97b9-2f05799d6573 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=d0df2e3dd45c43c5a6f10c28479732b9, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.268595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45015f-024b-482b-97b9-2f05799d6573 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.282135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 402/811] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:31 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/d0df2e3dd45c43c5a6f10c28479732b9/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:31.282918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45015f-024b-482b-97b9-2f05799d6573 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.333131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.341621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92627168-1d5f-4c1b-80fe-dcee4075bfe1 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.377835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.378585 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.378952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.379275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.380025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:31.380418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.382440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.387350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 410/812] 10.222.0.55 () {56 vars in 1124 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:31.388241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.415347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45015f-024b-482b-97b9-2f05799d6573 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.456620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b216c-7afc-45bf-9836-89c32f9b7e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.457265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b216c-7afc-45bf-9836-89c32f9b7e36 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.457524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b216c-7afc-45bf-9836-89c32f9b7e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.457797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b216c-7afc-45bf-9836-89c32f9b7e36 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.458633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b216c-7afc-45bf-9836-89c32f9b7e36 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:31.458836 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b216c-7afc-45bf-9836-89c32f9b7e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.460311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b216c-7afc-45bf-9836-89c32f9b7e36 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.479294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 403/813] 10.222.0.55 () {56 vars in 1149 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:31.480356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00566a-e47c-412a-9d82-b76997a29054 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.480641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00566a-e47c-412a-9d82-b76997a29054 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.480916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00566a-e47c-412a-9d82-b76997a29054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.500375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-2d00566a-e47c-412a-9d82-b76997a29054 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:31.501559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2d00566a-e47c-412a-9d82-b76997a29054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:31.508365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443401e0-0a9d-4d25-ac22-ec70da8e118c None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.516283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.547991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.549057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.549408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.549757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.551055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:31.551370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.553562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.574123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 404/814] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:31.574865 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00566a-e47c-412a-9d82-b76997a29054 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.586997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 411/815] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:31.587933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.619621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.704932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00566a-e47c-412a-9d82-b76997a29054 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.722487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f7ee-1531-4dc4-a416-d8df2d045341 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.749293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.749944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.750225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.750524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.751398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:31.751705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.753579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.760209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 405/816] 10.222.0.55 () {56 vars in 1124 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:31.761619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.767737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.768675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.769159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.769633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.781696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.783420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.796189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:31.800164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:31.807030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:31.807982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:31.807982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:31.807982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:31.808505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 412/817] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:31.809627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:31.880047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:31.885747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1796a-4511-4379-b0cf-23ef1f64a3f5 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.917461 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60566f7-322e-4fba-a10b-b4e0e75a6c95 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:31.924335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb10f4-0439-44bf-a463-6e39b8c06808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.925457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb10f4-0439-44bf-a463-6e39b8c06808 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.925735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb10f4-0439-44bf-a463-6e39b8c06808 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.926003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb10f4-0439-44bf-a463-6e39b8c06808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.958148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c23c6a-dadc-4610-a186-14aa22c51062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:31.959389 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23c6a-dadc-4610-a186-14aa22c51062 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:31.959569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23c6a-dadc-4610-a186-14aa22c51062 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:31.959880 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23c6a-dadc-4610-a186-14aa22c51062 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:31.960547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c23c6a-dadc-4610-a186-14aa22c51062 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:31.961926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c23c6a-dadc-4610-a186-14aa22c51062 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:31.986019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 413/818] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:30:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:31.986942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c23c6a-dadc-4610-a186-14aa22c51062 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.023311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb10f4-0439-44bf-a463-6e39b8c06808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.025489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb10f4-0439-44bf-a463-6e39b8c06808 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.051811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:32.116261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c23c6a-dadc-4610-a186-14aa22c51062 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.141518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:32.169154 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955542c-174b-4402-8854-680902cb62cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.170185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955542c-174b-4402-8854-680902cb62cb None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.170744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955542c-174b-4402-8854-680902cb62cb None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.171284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955542c-174b-4402-8854-680902cb62cb None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.172107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955542c-174b-4402-8854-680902cb62cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:32.172475 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955542c-174b-4402-8854-680902cb62cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.173985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955542c-174b-4402-8854-680902cb62cb None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.174105 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 406/819] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:30:32.174857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb10f4-0439-44bf-a463-6e39b8c06808 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.190450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 414/820] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:32.191432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955542c-174b-4402-8854-680902cb62cb None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.297270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb10f4-0439-44bf-a463-6e39b8c06808 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.314683 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955542c-174b-4402-8854-680902cb62cb None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.319446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:32.342048 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846027e6-7054-4a05-99b8-59191617328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.342781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846027e6-7054-4a05-99b8-59191617328b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.343228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846027e6-7054-4a05-99b8-59191617328b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.343579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846027e6-7054-4a05-99b8-59191617328b None admin] PATH_INFO: `/v3/services/network` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.344363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846027e6-7054-4a05-99b8-59191617328b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.345806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846027e6-7054-4a05-99b8-59191617328b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.352417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.353060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.353335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.353632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-846027e6-7054-4a05-99b8-59191617328b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:32.356137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:32.357333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 15:30:32.358353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:32.360719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 407/821] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:32 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:32.360719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846027e6-7054-4a05-99b8-59191617328b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.370621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.372150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:32.389452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:32.391485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:32.393492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:32.393492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:32.393492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:32.393492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 415/822] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:32.393492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.426312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:32.480616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846027e6-7054-4a05-99b8-59191617328b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.500975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a76cd-a032-40a8-8444-b83a773c0378 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.525833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.526825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.527285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.527802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.535508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.537482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.538458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.539067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.539390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.539798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.540448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] RBAC: Adding query filter params (name=network) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:32.540759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.542221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:32.550648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:32.551598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:32.553094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:32.553094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:32.553094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:32.553094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:32.553094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:32.553094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:32.553094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:32.553094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:32.553521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 416/823] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:32.553521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.555120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 408/824] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:32.556163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.598707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:32.660144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:32.667507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d91f21-2ec5-46a4-99a7-4f7aff3fdfcc None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.672536 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323ce26-8a4c-4af4-b5e5-c6fa512e27c5 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.706788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.708057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.708501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.709002 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.709832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:32.709958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.710461 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.710757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.711033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.711218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.711669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] RBAC: Adding query filter params (type=network) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:32.712007 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.713073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.713445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.723413 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 409/825] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:32.723413 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.733224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 417/826] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:32.734580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.834269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504258-e5a7-44dd-b165-43f08d398532 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.836216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:32.848716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d754f-c10e-4a10-9c72-cb1c5f8643ca None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:32.876818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.877440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.877723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.877999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.878808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:32.879124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.881234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.889014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85743f2-5f4e-4c3b-aaa2-829ac62d5042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:32.889890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85743f2-5f4e-4c3b-aaa2-829ac62d5042 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:32.890383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85743f2-5f4e-4c3b-aaa2-829ac62d5042 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:32.890993 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85743f2-5f4e-4c3b-aaa2-829ac62d5042 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:32.891953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85743f2-5f4e-4c3b-aaa2-829ac62d5042 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:32.893546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85743f2-5f4e-4c3b-aaa2-829ac62d5042 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:32.899097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 410/827] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:32.899097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.935809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 418/828] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:30:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:32.935809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85743f2-5f4e-4c3b-aaa2-829ac62d5042 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:32.968964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:33.105674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816786-ad68-473b-981e-3e2e5e0b389a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:33.178859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:33.179899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:33.180437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:33.180927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:33.182818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85743f2-5f4e-4c3b-aaa2-829ac62d5042 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:33.189377 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:33.191124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:33.203262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:33.204329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:33.205228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:33.205228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:33.205228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:33.205228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:33.205228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:33.205228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:33.205228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:33.205228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:33.207641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 411/829] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:33.216747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:33.221603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb35e4-440d-4f53-8315-d5d3ab26a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:33.222342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb35e4-440d-4f53-8315-d5d3ab26a37b None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:33.222629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb35e4-440d-4f53-8315-d5d3ab26a37b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:33.222905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb35e4-440d-4f53-8315-d5d3ab26a37b None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/7eaff7a61225436bb9e100b03f56441f/roles/c96f60a1a9284a17862e2507df5b15f0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:33.238920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb35e4-440d-4f53-8315-d5d3ab26a37b None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=7eaff7a61225436bb9e100b03f56441f, role_id=c96f60a1a9284a17862e2507df5b15f0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:33.241030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb35e4-440d-4f53-8315-d5d3ab26a37b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:33.258450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 419/830] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:32 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/7eaff7a61225436bb9e100b03f56441f/roles/c96f60a1a9284a17862e2507df5b15f0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:33.262443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:33.291077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca35e93-b2b3-465a-b198-f0669af4c438 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:33.291418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca35e93-b2b3-465a-b198-f0669af4c438 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:33.291684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca35e93-b2b3-465a-b198-f0669af4c438 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:33.295345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 420/831] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:33.300650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96568-e82b-44dd-a2ac-30de2fd243f5 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:33.300972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96568-e82b-44dd-a2ac-30de2fd243f5 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:33.301251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96568-e82b-44dd-a2ac-30de2fd243f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:33.323119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6cd96568-e82b-44dd-a2ac-30de2fd243f5 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:33.324372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6cd96568-e82b-44dd-a2ac-30de2fd243f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:33.372038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4739-9f74-4382-8d27-b8a846df816a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:33.385224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:33.419464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 421/832] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:33.423799 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:33.423799 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:33.423799 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:33.423799 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:33.424141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:33.424141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:33.426024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:33.441132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 412/833] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:33.452925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd96568-e82b-44dd-a2ac-30de2fd243f5 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:33.562678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd96568-e82b-44dd-a2ac-30de2fd243f5 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:33.597581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:33.598196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:33.598479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:33.598757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:33.600083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=9fbf473d168b4c9692f75a51c84b7db7) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:33.600404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:33.601851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:33.608164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 422/834] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:33 2022] GET /identity/v3/role_assignments?user.id=9fbf473d168b4c9692f75a51c84b7db7&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=32319452053845419798d329f1c194d4 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:33.694108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:33.803240 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d95b3f-3a50-42ef-9b29-056a0d1da74a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:33.804859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:33.840308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca58329-0900-4c6a-8b5e-4aa0c46cdd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:33.840941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58329-0900-4c6a-8b5e-4aa0c46cdd37 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:33.841215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58329-0900-4c6a-8b5e-4aa0c46cdd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:33.841482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58329-0900-4c6a-8b5e-4aa0c46cdd37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:33.852309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca58329-0900-4c6a-8b5e-4aa0c46cdd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-6ca58329-0900-4c6a-8b5e-4aa0c46cdd37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:33.857164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:33.858075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:33.858923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 413/835] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:33.864458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:33.921695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:33.992451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496b42-1ba1-4be8-9030-39f66e0da60d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:34.028905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf954cc1-1633-4b39-8b99-e1f52acd25f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:34.029512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954cc1-1633-4b39-8b99-e1f52acd25f7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.029791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954cc1-1633-4b39-8b99-e1f52acd25f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.030062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954cc1-1633-4b39-8b99-e1f52acd25f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.030718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf954cc1-1633-4b39-8b99-e1f52acd25f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:34.031016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf954cc1-1633-4b39-8b99-e1f52acd25f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:34.032414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf954cc1-1633-4b39-8b99-e1f52acd25f7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:34.040883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 423/836] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:34.046489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca58329-0900-4c6a-8b5e-4aa0c46cdd37 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:34.078496 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232209-d31d-44f6-b780-3a7cc52491bf None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.078703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232209-d31d-44f6-b780-3a7cc52491bf None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.078922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232209-d31d-44f6-b780-3a7cc52491bf None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.080575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 424/837] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:34.086032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bc6cc-8091-41b7-8896-27a922e130b0 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.086852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bc6cc-8091-41b7-8896-27a922e130b0 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.086852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bc6cc-8091-41b7-8896-27a922e130b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.108678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-323bc6cc-8091-41b7-8896-27a922e130b0 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:34.110279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-323bc6cc-8091-41b7-8896-27a922e130b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:34.164104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca58329-0900-4c6a-8b5e-4aa0c46cdd37 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:34.191800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 425/838] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:34.209541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:34.212407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.212407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.212407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.218033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:34.222244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:34.223745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:34.238246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:34.239206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:34.240727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:34.240727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:34.240727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:34.240727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 414/839] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:34.246705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bc6cc-8091-41b7-8896-27a922e130b0 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:34.304222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:34.350225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bc6cc-8091-41b7-8896-27a922e130b0 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:34.387768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:34.388440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.388853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.389124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.389759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:34.390057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:34.391430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:34.403342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 426/840] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:34.409118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:34.484888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:34.527697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ba375-5ba7-48f7-9b61-be1d0d78fd12 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:34.568082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:34.569070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.569579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.570059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.578228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:34.579922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:34.591719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:34.592758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 15:30:34.593685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:34.601130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 415/841] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:30:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:34.602204 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:34.610404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fc7-ed08-42a3-a47c-ba8ba7a51ac6 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:34.612429 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:34.658968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:34.659633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.659951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.660224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.660864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:34.663214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:34.671131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:34.674113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:34.675086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:34.676000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 427/842] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:34.682097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:34.752218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d89e7-33c2-46a8-a013-584a435275ac None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:34.791450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:34.792125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.792402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.792673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.793664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:34.794073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:34.795560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:34.801412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776153c-5fa1-46cd-a2ac-7549168526bb None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:34.823073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 416/843] 10.222.0.55 () {56 vars in 1135 bytes} [Thu Sep 1 15:30:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:34.828900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:34.850574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:34.851217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:34.851503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:34.851803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:34.852437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:34.852744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:34.854126 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:34.863128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 428/844] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:34.864174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:34.897700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:34.983631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7c853-c31f-4db2-838f-f3a445d2c8b6 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:34.988220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a020f3b-29c4-4dcc-a9db-1387a427a569 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.008264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.020610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac5c1a-aef0-4459-977b-481ce3f8691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.023395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac5c1a-aef0-4459-977b-481ce3f8691c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.023967 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac5c1a-aef0-4459-977b-481ce3f8691c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.024439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac5c1a-aef0-4459-977b-481ce3f8691c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.032923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.033537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.033822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.034100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.034989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:35.035168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.036555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.051824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 429/845] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:35.117024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac5c1a-aef0-4459-977b-481ce3f8691c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.118503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac5c1a-aef0-4459-977b-481ce3f8691c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.232262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 417/846] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:34 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:30:35.238324 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.307903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581b085-cb8b-4577-badb-9819049d9ba6 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.308149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581b085-cb8b-4577-badb-9819049d9ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.308434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581b085-cb8b-4577-badb-9819049d9ba6 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.311032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 418/847] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:35.315064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ed3a-41d1-4d41-82bd-4c81768d84c5 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.315350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ed3a-41d1-4d41-82bd-4c81768d84c5 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.315628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ed3a-41d1-4d41-82bd-4c81768d84c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.335625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-6793ed3a-41d1-4d41-82bd-4c81768d84c5 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:35.336731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6793ed3a-41d1-4d41-82bd-4c81768d84c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:35.338916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.342516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.350517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30033169-9de7-4fef-9cb7-b2a8c2eae1af None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.391453 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.392209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.392492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.392767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.408140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.410231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.417111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 419/848] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:35.432593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:35.433540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:35.434425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:35.434425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:35.434425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:35.436069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 430/849] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:35.444747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793ed3a-41d1-4d41-82bd-4c81768d84c5 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.553576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793ed3a-41d1-4d41-82bd-4c81768d84c5 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.590307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c2114-ca15-4306-b35a-55df8e1990ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.591170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2114-ca15-4306-b35a-55df8e1990ac None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.591590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2114-ca15-4306-b35a-55df8e1990ac None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.592039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c2114-ca15-4306-b35a-55df8e1990ac None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.592885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c2114-ca15-4306-b35a-55df8e1990ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:35.593337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c2114-ca15-4306-b35a-55df8e1990ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.594870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c2114-ca15-4306-b35a-55df8e1990ac None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.601785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.608342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 420/850] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:35.614273 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.664238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b9268-6739-4ae6-aa7e-18a5b9a7031c None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.664934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b9268-6739-4ae6-aa7e-18a5b9a7031c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.665422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b9268-6739-4ae6-aa7e-18a5b9a7031c None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.667204 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 421/851] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:35.672465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd981c94-e707-4362-ae5b-5dfe358071fe None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.672966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd981c94-e707-4362-ae5b-5dfe358071fe None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.673444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd981c94-e707-4362-ae5b-5dfe358071fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.692699 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-dd981c94-e707-4362-ae5b-5dfe358071fe None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:35.694635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-dd981c94-e707-4362-ae5b-5dfe358071fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:35.727364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bb791-6ba9-4b1c-9133-8de31648e36d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.766246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 422/852] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:35.766903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.767548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.767855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.768136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.768407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd981c94-e707-4362-ae5b-5dfe358071fe None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.775254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.777446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:35.790533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:35.791598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:35.792744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:35.792744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:35.792744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:35.792744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:35.792744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:35.792744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:35.792744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:35.792744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:35.798926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 431/853] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:35.800130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.810073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.911332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd981c94-e707-4362-ae5b-5dfe358071fe None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.915432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c830f-87ae-4509-87b6-3c2e66e19888 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:35.947726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:35.963919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.964493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e8ea1-fbb8-41ba-9625-5fceb706e2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:35.965040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.965149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e8ea1-fbb8-41ba-9625-5fceb706e2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:35.965408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e8ea1-fbb8-41ba-9625-5fceb706e2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.965684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e8ea1-fbb8-41ba-9625-5fceb706e2d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.966037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:35.966660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:35.967550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:35.968216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:35.970173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:35.977519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e8ea1-fbb8-41ba-9625-5fceb706e2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-a53e8ea1-fbb8-41ba-9625-5fceb706e2d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:35.982761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:35.983711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:30:35.984603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:35.993516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 423/855] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:35.993516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e8ea1-fbb8-41ba-9625-5fceb706e2d5 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:35.993730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 432/855] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:35.995235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.065523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.101517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e8ea1-fbb8-41ba-9625-5fceb706e2d5 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.106390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85d4e9-15e1-4af1-9855-ee5c1b503ddd None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.134936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.135545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.135852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.136134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.136804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.137110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.138475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.144327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.145262 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.145773 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.146185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 424/856] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:36.146514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.146972 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.147986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=d0df2e3dd45c43c5a6f10c28479732b9) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.148371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.149891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.159957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 433/857] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:35 2022] GET /identity/v3/role_assignments?user.id=d0df2e3dd45c43c5a6f10c28479732b9&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=32319452053845419798d329f1c194d4 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:36.160905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.242297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.311582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f294d4f-3571-4ef1-9b18-2aabfd29d14e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.313338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f2d6-60fb-473f-bfe2-ce637c218725 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.344923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.353502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.353929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.354580 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.354720 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.354855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.355132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.355428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.355723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.356130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.357121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:36.366883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:36.368010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:36.368929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 425/858] 10.222.0.55 () {56 vars in 1132 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:36.371639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.373381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.373982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:36.391516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:36.393053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:36.393926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:36.393926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:36.393926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:36.393926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 434/859] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:36.397768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.495877 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71329d4d-811b-4500-9cac-bdb01804de9c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.515292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.524765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13635480-db3a-4e81-a91e-0ba87866ee8b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.538850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.539637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.540096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.540472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.541216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.541905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.543210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.548817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 426/860] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:36.553703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.570586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c9896-602b-4638-a03c-489b8797623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.571213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c9896-602b-4638-a03c-489b8797623a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.571493 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c9896-602b-4638-a03c-489b8797623a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.571768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c9896-602b-4638-a03c-489b8797623a None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.572753 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c9896-602b-4638-a03c-489b8797623a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.573132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c9896-602b-4638-a03c-489b8797623a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.574825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c9896-602b-4638-a03c-489b8797623a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.593608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 435/861] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:36.598836 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c9896-602b-4638-a03c-489b8797623a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.651389 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.685294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41d65e-b33d-4785-8354-42a2d98b9ddc None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.721075 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c9896-602b-4638-a03c-489b8797623a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.723560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.724614 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.725427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.725908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.726772 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.727283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.729129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.736167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 427/862] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:36.777154 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.778176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.778684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.779169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.788166 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.790119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:36.803961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:36.804958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:36.805893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:36.808577 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 436/863] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:36.814781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:36.870340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:36.931837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8af0a-aeed-4415-ab18-0d169c5f404c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:36.983801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552643d7-eea8-4a4d-994a-5b06899a278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:36.983801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552643d7-eea8-4a4d-994a-5b06899a278f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:36.983801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552643d7-eea8-4a4d-994a-5b06899a278f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:36.983801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552643d7-eea8-4a4d-994a-5b06899a278f None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:36.984203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552643d7-eea8-4a4d-994a-5b06899a278f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:36.984203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552643d7-eea8-4a4d-994a-5b06899a278f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:36.987795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552643d7-eea8-4a4d-994a-5b06899a278f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.003008 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 428/864] 10.222.0.55 () {56 vars in 1149 bytes} [Thu Sep 1 15:30:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:37.008879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.043343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82551e4-8186-4f2a-98ab-81cca2a92091 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.044098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82551e4-8186-4f2a-98ab-81cca2a92091 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.044909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82551e4-8186-4f2a-98ab-81cca2a92091 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.050963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 429/865] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:37.053425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431144d-b1cf-42c8-bb5d-40efbedd2b61 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.053919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431144d-b1cf-42c8-bb5d-40efbedd2b61 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.054586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431144d-b1cf-42c8-bb5d-40efbedd2b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.079237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-8431144d-b1cf-42c8-bb5d-40efbedd2b61 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:37.080973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-8431144d-b1cf-42c8-bb5d-40efbedd2b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:37.144088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162dcb-838a-4221-88fe-b019ceae844a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.146117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:37.171314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 430/866] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:37.192535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37037-3e63-4240-88ef-3c106e5a8255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.193756 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37037-3e63-4240-88ef-3c106e5a8255 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.194034 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37037-3e63-4240-88ef-3c106e5a8255 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.194308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37037-3e63-4240-88ef-3c106e5a8255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.266960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37037-3e63-4240-88ef-3c106e5a8255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:37.268453 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37037-3e63-4240-88ef-3c106e5a8255 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.376868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 437/867] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:30:37.383800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431144d-b1cf-42c8-bb5d-40efbedd2b61 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.435367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:37.460367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37037-3e63-4240-88ef-3c106e5a8255 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.475219 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:37.497866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431144d-b1cf-42c8-bb5d-40efbedd2b61 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.535820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.538049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.538536 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.539295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.553437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:37.555697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:37.577522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:37.578489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:37.579370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:37.579370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:37.579370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:37.581869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 431/868] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:37.587948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37037-3e63-4240-88ef-3c106e5a8255 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.588091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.625076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bbf33-f843-498d-a0fa-b036031a1309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.626137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bbf33-f843-498d-a0fa-b036031a1309 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.626621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bbf33-f843-498d-a0fa-b036031a1309 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.627148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bbf33-f843-498d-a0fa-b036031a1309 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.628045 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bbf33-f843-498d-a0fa-b036031a1309 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:37.630184 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bbf33-f843-498d-a0fa-b036031a1309 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.658446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 438/869] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:30:37 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:30:37.678959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:37.700132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08831d55-49ac-48df-b5c2-cc73132fa736 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.746952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.747583 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.747904 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.748182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.748847 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:37.749154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:37.750548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.764304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 432/870] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:37.770025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bbf33-f843-498d-a0fa-b036031a1309 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:37.842813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:37.888167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bbf33-f843-498d-a0fa-b036031a1309 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:37.923865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:37.924509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:37.924789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:37.925060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:37.932556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:37.934056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:37.946930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:37.948091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:37.949247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 439/871] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:37.954248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:38.062913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09930c0d-3c0e-4a97-845c-587327524bac None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:38.103442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211693-8a7b-4f42-80f9-b95dfec14964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:38.103442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211693-8a7b-4f42-80f9-b95dfec14964 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.103442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211693-8a7b-4f42-80f9-b95dfec14964 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.103442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211693-8a7b-4f42-80f9-b95dfec14964 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.104109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211693-8a7b-4f42-80f9-b95dfec14964 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:38.104654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211693-8a7b-4f42-80f9-b95dfec14964 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:38.107137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211693-8a7b-4f42-80f9-b95dfec14964 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:38.117009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:38.120542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 433/872] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:38.129015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:38.168799 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff08e5-106e-4722-94e0-1862f524bea8 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.169041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff08e5-106e-4722-94e0-1862f524bea8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.169279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff08e5-106e-4722-94e0-1862f524bea8 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.174601 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 434/873] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:38.175763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38ebc-d18f-4204-a0b5-b1174b0e128c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.176088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38ebc-d18f-4204-a0b5-b1174b0e128c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.176371 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38ebc-d18f-4204-a0b5-b1174b0e128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.196567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-ead38ebc-d18f-4204-a0b5-b1174b0e128c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:38.198202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ead38ebc-d18f-4204-a0b5-b1174b0e128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:38.245502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69c71a-afc3-47aa-8544-3e45536eb753 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:38.278066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:38.283881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 435/874] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:38.296361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:38.296977 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.297254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.297605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.298337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=7eaff7a61225436bb9e100b03f56441f) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:38.298703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:38.300177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:38.306588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 440/875] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:38 2022] GET /identity/v3/role_assignments?user.id=7eaff7a61225436bb9e100b03f56441f&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:38.566314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead38ebc-d18f-4204-a0b5-b1174b0e128c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:38.671760 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead38ebc-d18f-4204-a0b5-b1174b0e128c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:38.708210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:38.713512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe269e45-63f5-409a-9e45-498f81d3787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:38.714188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269e45-63f5-409a-9e45-498f81d3787d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.714468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269e45-63f5-409a-9e45-498f81d3787d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.714736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe269e45-63f5-409a-9e45-498f81d3787d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.715320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe269e45-63f5-409a-9e45-498f81d3787d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:38.717898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe269e45-63f5-409a-9e45-498f81d3787d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-fe269e45-63f5-409a-9e45-498f81d3787d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:38.727986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:38.729013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:38.729878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 436/876] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:38.734950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:38.797888 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1470-1b0f-4190-a6fe-614e2cbb6aea None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.798221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1470-1b0f-4190-a6fe-614e2cbb6aea None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.803396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd1470-1b0f-4190-a6fe-614e2cbb6aea None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.803396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 437/877] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:38.805558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048503ae-150b-401e-9d7d-0b2d16ad449c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.805850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048503ae-150b-401e-9d7d-0b2d16ad449c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.806124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048503ae-150b-401e-9d7d-0b2d16ad449c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.825006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-048503ae-150b-401e-9d7d-0b2d16ad449c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:38.826231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-048503ae-150b-401e-9d7d-0b2d16ad449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:38.848176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499d48d-a1b8-4289-b203-576ca6e9f25d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:38.889948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:38.890937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:38.892067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:38.892582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:38.893751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:38.894291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:38.896580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:38.904523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 441/878] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:38.913782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:38.918985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 438/879] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:38.968439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:39.024706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f818c-2924-4c24-8545-509850557673 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:39.060707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46b42d-01b1-4935-9678-f09e1da745e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:39.061321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46b42d-01b1-4935-9678-f09e1da745e6 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.061603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46b42d-01b1-4935-9678-f09e1da745e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.061875 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46b42d-01b1-4935-9678-f09e1da745e6 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.062503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46b42d-01b1-4935-9678-f09e1da745e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:39.062810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46b42d-01b1-4935-9678-f09e1da745e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:39.064225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46b42d-01b1-4935-9678-f09e1da745e6 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:39.069261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 442/880] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:39.204588 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048503ae-150b-401e-9d7d-0b2d16ad449c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:39.310339 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048503ae-150b-401e-9d7d-0b2d16ad449c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:39.333812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:39.348530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1308f-8c05-433c-8c9b-5a1c7ed58315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:39.349840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1308f-8c05-433c-8c9b-5a1c7ed58315 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.350260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1308f-8c05-433c-8c9b-5a1c7ed58315 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.350663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1308f-8c05-433c-8c9b-5a1c7ed58315 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.351468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1308f-8c05-433c-8c9b-5a1c7ed58315 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:39.353010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1308f-8c05-433c-8c9b-5a1c7ed58315 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:39.373865 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 439/881] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:30:39 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:39.814195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d20cc-45fb-44f2-9a2e-e8735be8cb17 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.814704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d20cc-45fb-44f2-9a2e-e8735be8cb17 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.814810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d20cc-45fb-44f2-9a2e-e8735be8cb17 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.816239 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 443/882] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:39.822808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8ce1-1f1b-410d-a9ee-54b7f49322a9 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:39.823093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8ce1-1f1b-410d-a9ee-54b7f49322a9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:39.823373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8ce1-1f1b-410d-a9ee-54b7f49322a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:39.842606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-741d8ce1-1f1b-410d-a9ee-54b7f49322a9 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:39.843819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-741d8ce1-1f1b-410d-a9ee-54b7f49322a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:39.927892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 440/883] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:40.278852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d20cc-45fb-44f2-9a2e-e8735be8cb17 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.408870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d20cc-45fb-44f2-9a2e-e8735be8cb17 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.424684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:40.450919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fff63-d940-4d65-b792-0dd6b52913c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:40.451933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fff63-d940-4d65-b792-0dd6b52913c1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.452431 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fff63-d940-4d65-b792-0dd6b52913c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.452903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fff63-d940-4d65-b792-0dd6b52913c1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.453680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fff63-d940-4d65-b792-0dd6b52913c1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:40.455247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fff63-d940-4d65-b792-0dd6b52913c1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b96fff63-d940-4d65-b792-0dd6b52913c1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:40.465471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:40.466471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:40.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:40.474672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 444/884] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:40.476902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d8ce1-1f1b-410d-a9ee-54b7f49322a9 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.509353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de68e-f7bc-4833-97ef-e59d456cc8e5 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.509715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de68e-f7bc-4833-97ef-e59d456cc8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.509925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de68e-f7bc-4833-97ef-e59d456cc8e5 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.511479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 445/885] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:40.516604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced923e-836e-44e6-8688-2ece3ed752a3 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.516886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced923e-836e-44e6-8688-2ece3ed752a3 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.517163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced923e-836e-44e6-8688-2ece3ed752a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.544625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4ced923e-836e-44e6-8688-2ece3ed752a3 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:40.545750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4ced923e-836e-44e6-8688-2ece3ed752a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:40.597819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d8ce1-1f1b-410d-a9ee-54b7f49322a9 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.616779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:40.672540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:40.674000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.674490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.674965 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.676067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:40.677058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:40.678939 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:40.688933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 441/886] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:40.697153 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.703414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 446/887] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:40.815575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c1661-e0f4-481f-8ebc-2da106802b66 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:40.855439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:40.856429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:40.856949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:40.857442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:40.858268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:40.858787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:40.860471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:40.870332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 442/888] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:40.875525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced923e-836e-44e6-8688-2ece3ed752a3 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:40.996460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced923e-836e-44e6-8688-2ece3ed752a3 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.009260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.038383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.039165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.039546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.040006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.043796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] RBAC: Adding query filter params (interface=public, service_id=8111f1a7c92240d49d3fccc8493c4c66, region_id=RegionOne) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:41.043796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.043796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.055744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.067264 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 447/889] 10.222.0.55 () {56 vars in 1251 bytes} [Thu Sep 1 15:30:40 2022] GET /identity/v3/endpoints?service_id=8111f1a7c92240d49d3fccc8493c4c66&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:41.068530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.121309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.194342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213cffc-88ef-48e9-ba8a-02c66e2e8435 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.222883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9d392-3a55-4aac-b1ee-7d7e03e80640 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.232136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3e407-d904-47af-924d-7a571710338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.232755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e407-d904-47af-924d-7a571710338c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.233035 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e407-d904-47af-924d-7a571710338c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.233414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e407-d904-47af-924d-7a571710338c None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.234026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3e407-d904-47af-924d-7a571710338c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.235518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3e407-d904-47af-924d-7a571710338c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.242243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 448/890] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:30:41.243545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbb47f-0aac-4d12-a3d2-7d42d4d1b626 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.243856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbb47f-0aac-4d12-a3d2-7d42d4d1b626 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.244135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbb47f-0aac-4d12-a3d2-7d42d4d1b626 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.250011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 449/891] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:41.251433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7373a0-2bfb-4076-9516-78973b484725 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.251723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7373a0-2bfb-4076-9516-78973b484725 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.252041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7373a0-2bfb-4076-9516-78973b484725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.273475 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6e7373a0-2bfb-4076-9516-78973b484725 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:41.274693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6e7373a0-2bfb-4076-9516-78973b484725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:41.289605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae379927-3070-40c7-ac7a-e3aafed584fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.293024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379927-3070-40c7-ac7a-e3aafed584fd None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.295287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379927-3070-40c7-ac7a-e3aafed584fd None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.295863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae379927-3070-40c7-ac7a-e3aafed584fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.310252 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.326225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae379927-3070-40c7-ac7a-e3aafed584fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-ae379927-3070-40c7-ac7a-e3aafed584fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:41.332506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:41.334092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:30:41.334913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:41.342740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 443/892] 10.222.0.55 () {56 vars in 1120 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:41.348769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae379927-3070-40c7-ac7a-e3aafed584fd None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.407106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 450/893] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:41.485443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae379927-3070-40c7-ac7a-e3aafed584fd None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.495120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.505774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27dbf-fe06-4040-8b28-179e80453e17 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.506063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27dbf-fe06-4040-8b28-179e80453e17 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.506517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27dbf-fe06-4040-8b28-179e80453e17 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.508380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 451/894] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:41.513277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709494e1-22e9-4533-a33d-87cf62918f4f None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.513738 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709494e1-22e9-4533-a33d-87cf62918f4f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.514148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709494e1-22e9-4533-a33d-87cf62918f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.531331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.532164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.532444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.532716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.533558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:41.533867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.535232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.543574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-709494e1-22e9-4533-a33d-87cf62918f4f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:41.546499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-709494e1-22e9-4533-a33d-87cf62918f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:41.555853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 444/895] 10.222.0.55 () {56 vars in 1115 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:41.561344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.687800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 452/896] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:41.707014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709494e1-22e9-4533-a33d-87cf62918f4f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.747522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35be5-41fa-465d-9109-3ea1e1a3c168 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.789886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.790667 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.790956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.791236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.807810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.808012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:41.827416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:41.828453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:41.829336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:41.829336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:41.829336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:41.832069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 445/897] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:41.835187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:41.855117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.860911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:41.870581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709494e1-22e9-4533-a33d-87cf62918f4f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:41.931367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4a18-2c63-4a78-9036-ad8a755beea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:41.932087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4a18-2c63-4a78-9036-ad8a755beea9 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:41.932334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4a18-2c63-4a78-9036-ad8a755beea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:41.932590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4a18-2c63-4a78-9036-ad8a755beea9 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:41.933249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4a18-2c63-4a78-9036-ad8a755beea9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:41.934693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4a18-2c63-4a78-9036-ad8a755beea9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:41.972375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 453/898] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:30:41 2022] POST /identity/v3/services => generated 241 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:30:41.996608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4a18-2c63-4a78-9036-ad8a755beea9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.006126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da93ded-280b-4efc-9e65-6a1c83efcc74 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.070451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.071483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.073161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.073161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.074964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.074964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.075744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.101011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 446/899] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:42.102145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.179102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4a18-2c63-4a78-9036-ad8a755beea9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.206267 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.227905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.228412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.228693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.229146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.229550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.233534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:42.249481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:42.250545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:42.251476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:42.253228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 454/900] 10.222.0.55 () {56 vars in 1132 bytes} [Thu Sep 1 15:30:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:42.260396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fe4c6-551f-404c-8579-b08833cb8f5b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.261007 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.292486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.319713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.320427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.320712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.320992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.339804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.343803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:42.369701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:42.370885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:42.371949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 447/901] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:42.383798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.419986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabad45-38d7-4fe6-8f47-6a36176e9687 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.484730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.485277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.485557 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.485831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.486467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.486770 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.488218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.493893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 455/902] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:42.505439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.511973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce1f26-ff59-4da4-92fb-47fddb84ad2d None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.541967 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.553406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.554325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.554796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.555446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.556408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.557189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.558930 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.578758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 448/903] 10.222.0.55 () {56 vars in 1149 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:42.587399 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.699450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.722818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02abfc-74cc-434a-8eb1-c2e32e281a7a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.728872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986373d-d5c7-41bb-ae4b-d0a1ae450683 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:42.779256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba4c32-ec44-40a9-894e-8a346a0df811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.779979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4c32-ec44-40a9-894e-8a346a0df811 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.780262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4c32-ec44-40a9-894e-8a346a0df811 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.780533 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4c32-ec44-40a9-894e-8a346a0df811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.800925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:42.801814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:42.802274 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:42.802791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:42.803768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:42.806383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.808068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:42.816673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 456/904] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:42.828825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:42.851244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:42.883794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba4c32-ec44-40a9-894e-8a346a0df811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:42.885244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba4c32-ec44-40a9-894e-8a346a0df811 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.023501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89039a4-45da-4591-b136-18e29cf5ded2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.093104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.093532 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.093810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.094088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.094982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] RBAC: Adding query filter params (interface=public, service_id=5c023f470c3b4a6599a79f3fa67cf515, region_id=RegionOne) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:43.095292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.097123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.111298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 457/905] 10.222.0.55 () {56 vars in 1251 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/endpoints?service_id=5c023f470c3b4a6599a79f3fa67cf515&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:43.114948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.123067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 449/906] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:30:43.133001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba4c32-ec44-40a9-894e-8a346a0df811 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.154912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.303088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.326409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf4d34-4518-4835-b881-798cbaa00d01 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.338547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba4c32-ec44-40a9-894e-8a346a0df811 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.390218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15dde8-46e9-4abb-af0e-bea7ba529765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.392046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15dde8-46e9-4abb-af0e-bea7ba529765 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.393111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15dde8-46e9-4abb-af0e-bea7ba529765 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.393944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.394443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15dde8-46e9-4abb-af0e-bea7ba529765 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.395255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15dde8-46e9-4abb-af0e-bea7ba529765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.396147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.397937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.398439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.399656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15dde8-46e9-4abb-af0e-bea7ba529765 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.413952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 458/907] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/services => generated 1497 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:30:43.413952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e733c-33b3-455d-bb39-5b743554c068 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.413952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e733c-33b3-455d-bb39-5b743554c068 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.413952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e733c-33b3-455d-bb39-5b743554c068 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.413952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 459/908] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:43.419837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a5de-9f25-4084-8fbd-0bfa2d46005e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.420132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a5de-9f25-4084-8fbd-0bfa2d46005e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.420412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a5de-9f25-4084-8fbd-0bfa2d46005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.424533 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.426026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:43.449691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:43.451509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:43.452448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:43.452448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:43.452448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:43.455640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6742a5de-9f25-4084-8fbd-0bfa2d46005e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:43.456449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 450/909] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:43.458833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.459182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6742a5de-9f25-4084-8fbd-0bfa2d46005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:43.583371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 460/910] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:43.616827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e28afb-b513-4691-b9d6-38786cba8a67 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.669429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.675823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.675823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.675823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.675823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:43.675823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.675823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.677773 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.691167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 451/911] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:43.697141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742a5de-9f25-4084-8fbd-0bfa2d46005e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.714687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:43.834559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742a5de-9f25-4084-8fbd-0bfa2d46005e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:43.872706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:43.873698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:43.874246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:43.874728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:43.882044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:43.883739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:43.888830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:43.897812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:43.898731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:43.899620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 461/912] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:43.905288 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.027800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.062300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccae17-6b9f-4a7f-bb90-54783df4d4a4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.096145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9d347-f9a0-4e95-8094-b5d9f00aeb84 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.126273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e5e9a-22b8-4bea-9a3d-d51aec12a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.127223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5e9a-22b8-4bea-9a3d-d51aec12a230 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.127503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5e9a-22b8-4bea-9a3d-d51aec12a230 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.127794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5e9a-22b8-4bea-9a3d-d51aec12a230 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.128674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e5e9a-22b8-4bea-9a3d-d51aec12a230 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.130591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e5e9a-22b8-4bea-9a3d-d51aec12a230 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-ed4e5e9a-22b8-4bea-9a3d-d51aec12a230 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:44.142012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:44.143205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:44.144208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 452/913] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:44.145187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f111666-4f40-46b5-a6c6-bc04ed7969f1 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.145187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f111666-4f40-46b5-a6c6-bc04ed7969f1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.145187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f111666-4f40-46b5-a6c6-bc04ed7969f1 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.151797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 453/914] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:44.155819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b68f5-dcce-4aa2-b754-0461e0a30bc7 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.155819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b68f5-dcce-4aa2-b754-0461e0a30bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.155819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b68f5-dcce-4aa2-b754-0461e0a30bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.159756 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.160596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.160948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.161364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.162634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:44.163024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.164508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.174558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-1b6b68f5-dcce-4aa2-b754-0461e0a30bc7 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:44.175846 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1b6b68f5-dcce-4aa2-b754-0461e0a30bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:44.183248 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 462/915] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:44.183248 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.241068 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.259295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 454/916] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:44.261044 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b68f5-dcce-4aa2-b754-0461e0a30bc7 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.308886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345ee89-9001-41d7-9caa-c8db825bc532 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.340214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.355189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.356278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.358005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.359186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.360155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:44.360957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.364225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.370106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 463/917] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:44.378458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.393331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b68f5-dcce-4aa2-b754-0461e0a30bc7 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.441649 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.442266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.443066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.443340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.444121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] RBAC: Adding query filter params (role.id=ba4aa4f0a48640afab0266b6b2d880c6, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=7eaff7a61225436bb9e100b03f56441f) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:44.444434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.445874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.459158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 455/918] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/role_assignments?user.id=7eaff7a61225436bb9e100b03f56441f&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=ba4aa4f0a48640afab0266b6b2d880c6 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:44.548075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.602985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d0e2f-62c7-4287-890d-a11371761efa None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.661912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.675643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.677337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.677825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.678371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.679433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:44.680085 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.682670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.690133 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 464/919] 10.222.0.55 () {56 vars in 1114 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:44.703343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.730264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ec3ad-0a05-4882-bdf3-4ddf9e287c4a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.789814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.790457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.790740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.791014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.791608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.793034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:44.804404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:44.805392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:44.806256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 456/920] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:44.813244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:44.830295 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:44.914514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc12021-6567-4d6c-ae4d-d0ade92be9ee None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:44.976626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7aec-7ac5-4213-a025-9a7d61d4b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:44.977192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7aec-7ac5-4213-a025-9a7d61d4b0a3 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:44.977476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7aec-7ac5-4213-a025-9a7d61d4b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:44.977751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c7aec-7ac5-4213-a025-9a7d61d4b0a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:44.978582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c7aec-7ac5-4213-a025-9a7d61d4b0a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:44.979957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c7aec-7ac5-4213-a025-9a7d61d4b0a3 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:44.981765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bf33e-273c-4eef-86ed-24316aa989c6 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.008177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:45.035003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.036279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.036766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.037221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.038050 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:45.038550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.046033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 465/921] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:30:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:45.047054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.053587 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 457/922] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:45.061987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7aec-7ac5-4213-a025-9a7d61d4b0a3 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:45.200217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c7aec-7ac5-4213-a025-9a7d61d4b0a3 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.210132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:45.247671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.247671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.247671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.248023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.248574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:45.248877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.250325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.258596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 466/923] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:45.264038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:45.388550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a7ddc-93a2-4d90-981f-c6f24dfa08a8 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.426250 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd66a8f-0d2a-4c28-8441-ab5378c2dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.427741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd66a8f-0d2a-4c28-8441-ab5378c2dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.428274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd66a8f-0d2a-4c28-8441-ab5378c2dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.428753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd66a8f-0d2a-4c28-8441-ab5378c2dcc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.429668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd66a8f-0d2a-4c28-8441-ab5378c2dcc6 None admin] RBAC: Adding query filter params (interface=public, service_id=bdf3838831504c039d50a5453a66e0a5, region_id=RegionOne) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:45.430198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd66a8f-0d2a-4c28-8441-ab5378c2dcc6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.431854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd66a8f-0d2a-4c28-8441-ab5378c2dcc6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.437962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 458/924] 10.222.0.55 () {56 vars in 1251 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/endpoints?service_id=bdf3838831504c039d50a5453a66e0a5&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:45.444857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:45.576786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff55b50-3ea8-4cef-84a1-9702d3a088cd None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.577467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff55b50-3ea8-4cef-84a1-9702d3a088cd None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.577953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff55b50-3ea8-4cef-84a1-9702d3a088cd None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.579793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 459/925] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:45.584807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205ecd-2eb1-45c6-9e31-e273225c2def None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.585102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205ecd-2eb1-45c6-9e31-e273225c2def None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.585394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205ecd-2eb1-45c6-9e31-e273225c2def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.595435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead466cd-eef9-44bb-9b6b-56666a0d1c29 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:45.627448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-f5205ecd-2eb1-45c6-9e31-e273225c2def None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:45.629421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f5205ecd-2eb1-45c6-9e31-e273225c2def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:45.637582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c927b-6818-4311-94a7-0dc6fa60f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:45.638728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c927b-6818-4311-94a7-0dc6fa60f761 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:45.639216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c927b-6818-4311-94a7-0dc6fa60f761 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:45.639690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c927b-6818-4311-94a7-0dc6fa60f761 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:45.640653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c927b-6818-4311-94a7-0dc6fa60f761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:45.642479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c927b-6818-4311-94a7-0dc6fa60f761 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:45.658354 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 467/926] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:30:45 2022] GET /identity/v3/services => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:30:45.709928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:45.761104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 460/927] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:46.067060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c927b-6818-4311-94a7-0dc6fa60f761 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.116401 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:46.189224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c927b-6818-4311-94a7-0dc6fa60f761 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.232571 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.233152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.235795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.235795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.235795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.235795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:46.247799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:46.248791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 15:30:46.249677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:46.250622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 468/928] 10.222.0.55 () {56 vars in 1132 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:46.258728 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205ecd-2eb1-45c6-9e31-e273225c2def None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.376876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205ecd-2eb1-45c6-9e31-e273225c2def None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.416320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.416937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.417226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.417503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.418141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:46.418447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.421786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.425287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 461/929] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:46.431107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.575889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:46.575889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0da8c-820a-4845-9f23-58fc4f6cbef5 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.612004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42d690-3d51-4c87-b5da-7ec28c672f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.612628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d690-3d51-4c87-b5da-7ec28c672f80 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.612907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d690-3d51-4c87-b5da-7ec28c672f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.613180 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d690-3d51-4c87-b5da-7ec28c672f80 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.613814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d690-3d51-4c87-b5da-7ec28c672f80 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:46.614114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d690-3d51-4c87-b5da-7ec28c672f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.615526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d690-3d51-4c87-b5da-7ec28c672f80 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.621070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 469/930] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:46.628862 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:46.671436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412884ec-b0d6-4825-9a79-6c4ab52ad1ac None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.671738 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412884ec-b0d6-4825-9a79-6c4ab52ad1ac None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.672712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412884ec-b0d6-4825-9a79-6c4ab52ad1ac None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.674582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 470/931] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:46.681332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8879f6-82a3-42f4-96b4-9ef55ae2f202 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.683825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8879f6-82a3-42f4-96b4-9ef55ae2f202 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.683825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8879f6-82a3-42f4-96b4-9ef55ae2f202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.692184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:46.714484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-9e8879f6-82a3-42f4-96b4-9ef55ae2f202 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:46.716270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9e8879f6-82a3-42f4-96b4-9ef55ae2f202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:46.793814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59292660-1a27-4b62-848b-9c9e8d802e4e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:46.838730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6abd-2a20-4cd3-b9f5-c578a6d970ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:46.839530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6abd-2a20-4cd3-b9f5-c578a6d970ba None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:46.839857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6abd-2a20-4cd3-b9f5-c578a6d970ba None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:46.840150 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6abd-2a20-4cd3-b9f5-c578a6d970ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:46.840810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6abd-2a20-4cd3-b9f5-c578a6d970ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:46.842371 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6abd-2a20-4cd3-b9f5-c578a6d970ba None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:46.856048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 471/932] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:46.891848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 462/933] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:30:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:47.222823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8879f6-82a3-42f4-96b4-9ef55ae2f202 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.319085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e0599-cdcc-4258-b057-aceecb1deb80 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.319403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e0599-cdcc-4258-b057-aceecb1deb80 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.319637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e0599-cdcc-4258-b057-aceecb1deb80 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.321281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 463/934] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:47.326715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236389-af6c-4e19-8fc4-e4d5999ad1a6 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.327000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236389-af6c-4e19-8fc4-e4d5999ad1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.327277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236389-af6c-4e19-8fc4-e4d5999ad1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.340066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.355817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-49236389-af6c-4e19-8fc4-e4d5999ad1a6 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:47.355817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-49236389-af6c-4e19-8fc4-e4d5999ad1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:47.356586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8879f6-82a3-42f4-96b4-9ef55ae2f202 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.430126 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1c810-8675-49b1-b898-8744be2ca5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.430784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1c810-8675-49b1-b898-8744be2ca5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.431067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1c810-8675-49b1-b898-8744be2ca5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.431941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1c810-8675-49b1-b898-8744be2ca5e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.453354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 464/935] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:47.463811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1c810-8675-49b1-b898-8744be2ca5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-92b1c810-8675-49b1-b898-8744be2ca5e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:47.471985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:47.472968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:47.473841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 472/936] 10.222.0.55 () {56 vars in 1120 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:47.483827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236389-af6c-4e19-8fc4-e4d5999ad1a6 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.511921 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.598678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236389-af6c-4e19-8fc4-e4d5999ad1a6 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.637050 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1e00d-55a3-4b55-9d51-6634c63fe4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.637959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1e00d-55a3-4b55-9d51-6634c63fe4ef None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.638443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1e00d-55a3-4b55-9d51-6634c63fe4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.638889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1e00d-55a3-4b55-9d51-6634c63fe4ef None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.639738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1e00d-55a3-4b55-9d51-6634c63fe4ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:47.640238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1e00d-55a3-4b55-9d51-6634c63fe4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:47.641764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1e00d-55a3-4b55-9d51-6634c63fe4ef None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:47.651227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 465/937] 10.222.0.55 () {56 vars in 1115 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:47.657073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1c810-8675-49b1-b898-8744be2ca5e8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.763004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5ae9-1773-416e-ac73-2ca7b1cabadd None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.763575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5ae9-1773-416e-ac73-2ca7b1cabadd None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.764189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd5ae9-1773-416e-ac73-2ca7b1cabadd None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.766613 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 466/938] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:47.767511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1c810-8675-49b1-b898-8744be2ca5e8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:47.774838 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8cab-9541-4945-a200-0c12033f496f None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.775124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8cab-9541-4945-a200-0c12033f496f None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.775398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc8cab-9541-4945-a200-0c12033f496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.800999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-64dc8cab-9541-4945-a200-0c12033f496f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:47.802911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-64dc8cab-9541-4945-a200-0c12033f496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:47.816231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:47.816868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:47.817149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:47.818029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:47.828907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:47.830539 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:47.842763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:47.851859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:47.853020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:47.853928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:47.853928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:47.853928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:47.859541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 473/939] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:47.860422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.900578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 467/940] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:47.901080 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc8cab-9541-4945-a200-0c12033f496f None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:47.956092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:47.971911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555a8f7-45aa-43b6-8e93-2fa9d3804b01 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.011109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.012107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.012624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.013149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.014020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.015672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.018509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING keystone.server.flask.common [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 15:30:48.040978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.sql.core [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 15:30:48.040978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 15:30:48.040978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [parameters: {'id': 'f9b49a8317f9492592e4de07d332a5c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 15:30:48.040978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81745) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9b49a8317f9492592e4de07d332a5c9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9b49a8317f9492592e4de07d332a5c9. Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:30:48.051161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application result.read() Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 15:30:48.052590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application yield resource Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise self.value Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application session.commit() Sep 01 15:30:48.053555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.session.flush() Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application compat.raise_( Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 15:30:48.054421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 15:30:48.055321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application result.read() Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:30:48.056153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [parameters: {'id': 'f9b49a8317f9492592e4de07d332a5c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.057027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.058891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9b49a8317f9492592e4de07d332a5c9. Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.065488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 474/941] 10.222.0.55 () {60 vars in 1140 bytes} [Thu Sep 1 15:30:47 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.067093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.083846 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc8cab-9541-4945-a200-0c12033f496f None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.128068 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.128692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.128972 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.129246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.129944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.130248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.131632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.145174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 468/942] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:48.157023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.202095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.261256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f435805-d360-46bc-bcc6-578a4bbeef8d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.280814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.298274 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.299020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.299351 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.299941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.306839 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131b27-217b-4adb-8743-c329abd4b9e0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.310447 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.312148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:48.328951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.329871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.330759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:48.330759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:48.330759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:48.330759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:48.330759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:48.330759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:48.330759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:48.330759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.335945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 475/943] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.336666 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.351348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.352425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.352911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.353469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.365033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.366958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:48.382474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.383586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:48.384816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:48.390943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 469/944] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:48.390943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.474905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af98f63-6f3c-4641-9b2b-ef1ae120ea8b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.499821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.525453 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.526279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.526496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76641-75ee-4964-914b-f23cef20f2a9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.526611 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.526827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.527419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.528837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:48.543023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:48.544235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:48.545065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:48.545792 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 476/945] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:48.546931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.571695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.572452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.572790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.573234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.573916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.574237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.575941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.588176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.604306 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 470/946] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:48.605258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.705916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd122476-6bfd-47f7-8dd1-2a576a74e78f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.760369 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.760996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.761286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.761550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.762297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.762605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.765509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.794223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 477/947] 10.222.0.55 () {56 vars in 1149 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:48.800313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b304dba-c35b-42a4-a0e5-1bf56483213e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.802481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.860284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:48.860908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:48.861189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:48.861466 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:48.862113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:48.862416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:48.866016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:48.874168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:48.879159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 471/948] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:48.885725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:48.964003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3135ce-b834-46d2-be8b-70b03889b7f9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:48.969453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.004351 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.005797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.006243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.006673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.016113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586ede-043f-4fce-8800-cc133bd1387b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.019569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.021809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:49.038711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:49.039967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:49.040957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:49.040957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:49.040957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:49.042986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 478/949] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:49.053536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.057663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.057663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.057663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.057663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.059137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.059137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.063943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.070796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 472/950] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:49.077384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.173173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.186804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9b6d8-6300-415a-96dd-ff5c434d61c7 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.204764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7952e-72f3-4c98-9f53-3cee16bce6ac None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.228621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9120b3-80c5-4b46-afa0-f3db54571b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.228940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9120b3-80c5-4b46-afa0-f3db54571b9f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.229156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9120b3-80c5-4b46-afa0-f3db54571b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.229427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9120b3-80c5-4b46-afa0-f3db54571b9f None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.230078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9120b3-80c5-4b46-afa0-f3db54571b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.230384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9120b3-80c5-4b46-afa0-f3db54571b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.231803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9120b3-80c5-4b46-afa0-f3db54571b9f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.235022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.247809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a50fa-6b63-426e-b497-509cde073e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.247809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a50fa-6b63-426e-b497-509cde073e90 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.247809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a50fa-6b63-426e-b497-509cde073e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.248153 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a50fa-6b63-426e-b497-509cde073e90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.249506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a50fa-6b63-426e-b497-509cde073e90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.250852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 479/951] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:49.250993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a50fa-6b63-426e-b497-509cde073e90 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.251643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026619-1335-488a-94d6-483859bdf540 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.251995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026619-1335-488a-94d6-483859bdf540 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.252277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026619-1335-488a-94d6-483859bdf540 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.254083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 480/952] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:49.254833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad026619-1335-488a-94d6-483859bdf540 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.280039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 473/953] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:30:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:30:49.280039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097f10-853e-416b-8e92-a51891843722 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.280039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097f10-853e-416b-8e92-a51891843722 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.280039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097f10-853e-416b-8e92-a51891843722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.300383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-8e097f10-853e-416b-8e92-a51891843722 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:49.302439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-8e097f10-853e-416b-8e92-a51891843722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:49.394514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 474/954] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:49.464138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad026619-1335-488a-94d6-483859bdf540 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.515114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.515752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.516060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.516330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.526099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.527569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:49.541891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:49.542882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:49.544094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 481/955] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:49.549282 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e097f10-853e-416b-8e92-a51891843722 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.658429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e097f10-853e-416b-8e92-a51891843722 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.676353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.696720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.697822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.698327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.698795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.699683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:49.700285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.701918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.710376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.715870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 475/956] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:49.722685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:49.752146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:49.848312 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a80d39-2ff4-4b71-9062-dc5c4bb2e9aa None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.893229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857bd4e-353b-4e42-9110-0b793d8f5f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.894676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857bd4e-353b-4e42-9110-0b793d8f5f92 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.895185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857bd4e-353b-4e42-9110-0b793d8f5f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.897738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857bd4e-353b-4e42-9110-0b793d8f5f92 None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/7eaff7a61225436bb9e100b03f56441f/roles/ba4aa4f0a48640afab0266b6b2d880c6` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.900830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857bd4e-353b-4e42-9110-0b793d8f5f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=7eaff7a61225436bb9e100b03f56441f, role_id=ba4aa4f0a48640afab0266b6b2d880c6)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:49.902557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857bd4e-353b-4e42-9110-0b793d8f5f92 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:49.921774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 476/957] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:30:49 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/7eaff7a61225436bb9e100b03f56441f/roles/ba4aa4f0a48640afab0266b6b2d880c6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:30:49.943828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36f8b-4940-442a-a94c-4b990996f71d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:49.997730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:49.998390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:49.998673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:49.998948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:49.999540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.000980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:50.019033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:50.020387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:50.021255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 482/958] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:50.026490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857bd4e-353b-4e42-9110-0b793d8f5f92 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.076169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.173039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857bd4e-353b-4e42-9110-0b793d8f5f92 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.221384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fc7f4-9241-4762-9dbc-cea2f89ba2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.222175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fc7f4-9241-4762-9dbc-cea2f89ba2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.222547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fc7f4-9241-4762-9dbc-cea2f89ba2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.222924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fc7f4-9241-4762-9dbc-cea2f89ba2c7 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.224323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fc7f4-9241-4762-9dbc-cea2f89ba2c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:50.224739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fc7f4-9241-4762-9dbc-cea2f89ba2c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.226212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fc7f4-9241-4762-9dbc-cea2f89ba2c7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.231800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 477/959] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:50.244733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:50.381149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:50.393384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd991f9-38b5-4514-b601-de612a9a38a7 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:50.444210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68fcd0-a78d-4125-9851-0c6ea933a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:50.444939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fcd0-a78d-4125-9851-0c6ea933a938 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.445325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fcd0-a78d-4125-9851-0c6ea933a938 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.445705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fcd0-a78d-4125-9851-0c6ea933a938 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.446450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68fcd0-a78d-4125-9851-0c6ea933a938 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:50.446860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68fcd0-a78d-4125-9851-0c6ea933a938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:50.448577 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68fcd0-a78d-4125-9851-0c6ea933a938 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:50.460011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 483/960] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:50.828805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012184-693e-4cb6-8197-e42205c2259a None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.829016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012184-693e-4cb6-8197-e42205c2259a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.829297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012184-693e-4cb6-8197-e42205c2259a None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.830989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 478/961] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:50.839536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215914e-259c-4440-b001-9cadbe1582a8 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:50.839536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215914e-259c-4440-b001-9cadbe1582a8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:50.839536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215914e-259c-4440-b001-9cadbe1582a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:50.867241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-2215914e-259c-4440-b001-9cadbe1582a8 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:50.868777 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2215914e-259c-4440-b001-9cadbe1582a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:50.965543 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 484/962] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:51.324834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3012184-693e-4cb6-8197-e42205c2259a None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.435040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.446835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3012184-693e-4cb6-8197-e42205c2259a None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.498697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.499321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.499604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.499912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.500573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.502010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.504871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING keystone.server.flask.common [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 15:30:51.525064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.sql.core [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 15:30:51.525064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 15:30:51.525064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [parameters: {'user_id': '0cef651f525548c9818f128b3ab8c179', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 15:30:51.525064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81746) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-06863040-507e-43db-80e3-f40e14ee3053 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application result.read() Sep 01 15:30:51.542229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:30:51.543192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application yield resource Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application next(self.gen) Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise self.value Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application session.commit() Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 15:30:51.544209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self.session.flush() Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application compat.raise_( Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 15:30:51.545118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 15:30:51.546011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application conn.query(q) Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application result.read() Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 15:30:51.546848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [parameters: {'user_id': '0cef651f525548c9818f128b3ab8c179', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:51.547677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 15:30:51.551431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 15:30:51.552864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 15:30:51.552864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 15:30:51.552864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 15:30:51.552864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 15:30:51.552864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 15:30:51.552864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:51.552864 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 479/963] 10.222.0.55 () {60 vars in 1131 bytes} [Thu Sep 1 15:30:51 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:51.553345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41800b24-051d-48c4-b642-93d88dbd64c6 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.553345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41800b24-051d-48c4-b642-93d88dbd64c6 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.553345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41800b24-051d-48c4-b642-93d88dbd64c6 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.553345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 485/964] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:51.553639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093428b2-baf4-4853-a050-5c872da79c21 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.553873 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093428b2-baf4-4853-a050-5c872da79c21 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.554161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093428b2-baf4-4853-a050-5c872da79c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.562636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41800b24-051d-48c4-b642-93d88dbd64c6 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.590733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-093428b2-baf4-4853-a050-5c872da79c21 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:51.592373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-093428b2-baf4-4853-a050-5c872da79c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:51.683828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.684059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 480/965] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:51.726518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41800b24-051d-48c4-b642-93d88dbd64c6 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:51.764900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:51.765542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:51.765824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:51.766101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:51.774524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:51.775943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:51.789213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:51.790182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:51.791135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 486/966] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:51.800886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093428b2-baf4-4853-a050-5c872da79c21 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:51.940257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:51.965532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093428b2-baf4-4853-a050-5c872da79c21 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.021311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6ce95-66ae-4d86-8c16-76cd195dd15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.027796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ce95-66ae-4d86-8c16-76cd195dd15b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.027796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ce95-66ae-4d86-8c16-76cd195dd15b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.027796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ce95-66ae-4d86-8c16-76cd195dd15b None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.027796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6ce95-66ae-4d86-8c16-76cd195dd15b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:52.027796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6ce95-66ae-4d86-8c16-76cd195dd15b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.027796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6ce95-66ae-4d86-8c16-76cd195dd15b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.033031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.112739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 481/967] 10.222.0.55 () {56 vars in 1101 bytes} [Thu Sep 1 15:30:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:52.169235 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f3d4-b080-411c-92d5-f242c48f9755 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.169890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f3d4-b080-411c-92d5-f242c48f9755 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.170388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f3d4-b080-411c-92d5-f242c48f9755 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.172363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 482/968] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:52.181591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049955d-7f1a-4cf3-a4af-1e323f7dd114 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.182243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049955d-7f1a-4cf3-a4af-1e323f7dd114 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.182851 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049955d-7f1a-4cf3-a4af-1e323f7dd114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.185664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2124-37d4-4e27-a3a0-6ec69b442d9a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.207269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-a049955d-7f1a-4cf3-a4af-1e323f7dd114 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:52.209231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a049955d-7f1a-4cf3-a4af-1e323f7dd114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:52.226784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:52.240696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.241358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.242015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.242312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.242922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.244421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:52.257596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:52.258710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:52.259574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 487/969] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:52.264795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.340076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 483/970] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:52.407099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372cc34-17e0-4ba7-bcbc-4cd925f61114 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.449007 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096c0f0-d11b-4451-a643-80c48845842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.451851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c0f0-d11b-4451-a643-80c48845842f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.451851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c0f0-d11b-4451-a643-80c48845842f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.451851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c0f0-d11b-4451-a643-80c48845842f None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.451851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096c0f0-d11b-4451-a643-80c48845842f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:52.451851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096c0f0-d11b-4451-a643-80c48845842f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.452543 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096c0f0-d11b-4451-a643-80c48845842f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.458238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 488/971] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:52.466192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049955d-7f1a-4cf3-a4af-1e323f7dd114 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.587048 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:52.617882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049955d-7f1a-4cf3-a4af-1e323f7dd114 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.620093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9327e4-2f70-437c-850b-ff0aa51057a9 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.620385 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9327e4-2f70-437c-850b-ff0aa51057a9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.620662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9327e4-2f70-437c-850b-ff0aa51057a9 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.622268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 489/972] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:52.627169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e011d-fe2f-489f-9078-ad20514e150e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.627460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e011d-fe2f-489f-9078-ad20514e150e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.627740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e011d-fe2f-489f-9078-ad20514e150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.651883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-360e011d-fe2f-489f-9078-ad20514e150e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:52.651883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-360e011d-fe2f-489f-9078-ad20514e150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:52.660144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.661607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.661891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.662435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.663092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:52.663399 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.665337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.671592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 484/973] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:52.672654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.708091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:52.736286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 490/974] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:52.736286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e011d-fe2f-489f-9078-ad20514e150e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.824132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acd570-d363-42e2-90bf-488a1e32eec2 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.853231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e011d-fe2f-489f-9078-ad20514e150e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:52.875459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c580981-b6b8-4c65-b3ea-541846d386e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.876438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580981-b6b8-4c65-b3ea-541846d386e3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.876966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580981-b6b8-4c65-b3ea-541846d386e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.877432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580981-b6b8-4c65-b3ea-541846d386e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.881538 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:52.894047 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c580981-b6b8-4c65-b3ea-541846d386e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:30:52.898414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:52.898414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:52.898414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:52.898801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:52.899893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] RBAC: Adding query filter params (interface=admin, service_id=bdf3838831504c039d50a5453a66e0a5, region_id=RegionOne) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-2c580981-b6b8-4c65-b3ea-541846d386e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:30:52.899994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:52.900875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:30:52.901710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:52.902895 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:52.902895 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:52.907930 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 485/975] 10.222.0.55 () {56 vars in 1120 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:52.907930 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c580981-b6b8-4c65-b3ea-541846d386e3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.915546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 491/976] 10.222.0.55 () {56 vars in 1249 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/endpoints?service_id=bdf3838831504c039d50a5453a66e0a5&interface=admin®ion_id=RegionOne => generated 193 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:52.916926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:52.980810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.041635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c580981-b6b8-4c65-b3ea-541846d386e3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.045476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c4fc3-59da-43e9-9647-2408a9ba6a87 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.079528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.080169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.080453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.080735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.081402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:53.081712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.083135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.087534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c05bb-558b-40e6-a4da-b3be3108c45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.088187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c05bb-558b-40e6-a4da-b3be3108c45e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.088471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c05bb-558b-40e6-a4da-b3be3108c45e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.088748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c05bb-558b-40e6-a4da-b3be3108c45e None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.089350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c05bb-558b-40e6-a4da-b3be3108c45e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.090709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c05bb-558b-40e6-a4da-b3be3108c45e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.091857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 486/977] 10.222.0.55 () {56 vars in 1115 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:53.092642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.101512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 492/978] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:30:52 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:30:53.102317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c05bb-558b-40e6-a4da-b3be3108c45e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.181733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.245703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c05bb-558b-40e6-a4da-b3be3108c45e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.247549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9a105-67a1-4c69-990f-979c932fa203 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.264972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.294705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.295265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.295548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.295849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.300189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85509-8b04-45f4-b68b-f253bf8abd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.300807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85509-8b04-45f4-b68b-f253bf8abd50 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.301089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85509-8b04-45f4-b68b-f253bf8abd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.301361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85509-8b04-45f4-b68b-f253bf8abd50 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.302589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba85509-8b04-45f4-b68b-f253bf8abd50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.303991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba85509-8b04-45f4-b68b-f253bf8abd50 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.316593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.318235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.326911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 487/979] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:30:53 2022] POST /identity/v3/services => generated 242 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:53.347975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:53.349562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:53.350454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:53.350454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:53.350454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:53.350454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 493/980] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:53.355723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85509-8b04-45f4-b68b-f253bf8abd50 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.525899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85509-8b04-45f4-b68b-f253bf8abd50 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.561712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:53.605108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.606831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.607598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.608319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.610114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:53.610913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.615089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.639286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 488/981] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:53.651804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.831873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe031d-a52a-49f5-94fb-723f477c2c0b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:53.867818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:53.867818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:53.867818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:53.867818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:53.875688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:53.877349 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:30:53.888861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:53.889841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 15:30:53.890809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:53.899514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:53.911504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 494/982] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:54.003802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30c20-4563-43ef-bf5e-e2ac660ec271 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.039549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.040179 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.040462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.040733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.041458 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:54.041764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.043180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.060034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 489/983] 10.222.0.55 () {56 vars in 1149 bytes} [Thu Sep 1 15:30:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:54.065492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.094694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.167119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62027-8583-4a15-8b21-88bf6fc29f7d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.200063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df3e2-151d-42b4-86d0-b1767559900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.200692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df3e2-151d-42b4-86d0-b1767559900b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.200969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df3e2-151d-42b4-86d0-b1767559900b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.201236 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df3e2-151d-42b4-86d0-b1767559900b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.269426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86df3e2-151d-42b4-86d0-b1767559900b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.271495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86df3e2-151d-42b4-86d0-b1767559900b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.297520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.371367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 495/984] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:30:54.376724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.411623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.482761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc320e34-6c43-4074-919c-be36d939cf3b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.517629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.518270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.518543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.518814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.529671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.531108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:30:54.545993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:54.546916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:30:54.548449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:30:54.548449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:30:54.548449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:54.548449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 490/985] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:54.552634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df3e2-151d-42b4-86d0-b1767559900b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.649634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df3e2-151d-42b4-86d0-b1767559900b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.674915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.684641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.685250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.685585 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.685796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.686432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:54.686729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.688128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.700046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 496/986] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:54.705365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.790740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:54.807623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc2f5d-da49-41fa-a91f-ae5179e623fb None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:54.842316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:54.842947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:54.843228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:54.843502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:54.850154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:54.851585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:30:54.862757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:54.863644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:54.865118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:30:54.865118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:30:54.865118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:30:54.865118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:30:54.865118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:30:54.865118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:30:54.865118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:30:54.865118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:54.868231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 491/987] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:54.869673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:54.982997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eaf9a-6854-4d4a-8870-fd5099488eea None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.021334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55815e-da66-445e-827e-d325092b99ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.022607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55815e-da66-445e-827e-d325092b99ed None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.022894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55815e-da66-445e-827e-d325092b99ed None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.023168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55815e-da66-445e-827e-d325092b99ed None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.023900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55815e-da66-445e-827e-d325092b99ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:55.024213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55815e-da66-445e-827e-d325092b99ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.025660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55815e-da66-445e-827e-d325092b99ed None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.043063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 497/988] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:30:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:55.044561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.062154 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21328c05-c9f7-475d-9873-a86c531578dd None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.062448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21328c05-c9f7-475d-9873-a86c531578dd None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.062712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21328c05-c9f7-475d-9873-a86c531578dd None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.064316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 498/989] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:55.071743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1d6c-ad46-495a-9378-d4f88999783b None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.072317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1d6c-ad46-495a-9378-d4f88999783b None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.072395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1d6c-ad46-495a-9378-d4f88999783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.092677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-370b1d6c-ad46-495a-9378-d4f88999783b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:55.093567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-370b1d6c-ad46-495a-9378-d4f88999783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:55.143434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.166266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e597fdc-9354-4495-8ff4-6f5431db55cf None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.177051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 499/990] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:55.211759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19342489-620f-4f65-b9ce-c3620fdd85d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.212414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342489-620f-4f65-b9ce-c3620fdd85d5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.212747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342489-620f-4f65-b9ce-c3620fdd85d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.213023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342489-620f-4f65-b9ce-c3620fdd85d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.213761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19342489-620f-4f65-b9ce-c3620fdd85d5 None admin] RBAC: Adding query filter params (role.id=ba4aa4f0a48640afab0266b6b2d880c6, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=7eaff7a61225436bb9e100b03f56441f) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:55.214070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19342489-620f-4f65-b9ce-c3620fdd85d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.215551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19342489-620f-4f65-b9ce-c3620fdd85d5 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.222238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 492/991] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/role_assignments?user.id=7eaff7a61225436bb9e100b03f56441f&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=ba4aa4f0a48640afab0266b6b2d880c6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:55.284817 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcd41-ef69-4a5e-91fe-b8bc1ce7d127 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.285103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcd41-ef69-4a5e-91fe-b8bc1ce7d127 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.285381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcd41-ef69-4a5e-91fe-b8bc1ce7d127 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.287873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 500/992] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:55.295806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ae9f-a2e4-47af-b20d-8e19efb10346 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.295806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ae9f-a2e4-47af-b20d-8e19efb10346 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.295806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ae9f-a2e4-47af-b20d-8e19efb10346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.316180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d823ae9f-a2e4-47af-b20d-8e19efb10346 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:55.319063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d823ae9f-a2e4-47af-b20d-8e19efb10346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:55.321439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.397600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 493/993] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:55.455661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bcd41-ef69-4a5e-91fe-b8bc1ce7d127 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.554474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bcd41-ef69-4a5e-91fe-b8bc1ce7d127 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.586782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.587408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.587687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.587989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.588567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.589931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:55.599210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:55.600214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 15:30:55.601082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:55.603845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 501/994] 10.222.0.55 () {56 vars in 1126 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:55.606362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823ae9f-a2e4-47af-b20d-8e19efb10346 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.678742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.708775 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823ae9f-a2e4-47af-b20d-8e19efb10346 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.724689 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.749350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.749975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.750260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.750538 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.751430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:55.751745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.753908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.760034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 494/995] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:55.765472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.768101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:55.789977 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62225b30-9d22-4bb2-9faf-fc6defc500b1 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.829349 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.830301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.830764 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.831215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.832004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.834070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:55.842804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:55.844070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:55.844976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 502/996] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:30:55.850276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.878145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5df8ae-e2be-492d-8ca5-d1146e0d512f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.915573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:55.916442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:55.916724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:55.916997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:55.917630 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:55.917932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:55.919301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:55.924230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 495/997] 10.222.0.55 () {56 vars in 1122 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:55.929858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:55.962268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2961a7-7b0c-4c7b-8946-7ef1f649f54e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:55.964957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.004227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.004868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.005099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.005188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.005412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.006038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:56.006356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.008237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.013293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 503/998] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:56.018856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.044623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b10ef7-6801-4d79-b4bd-530d9242c6e7 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.079005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a9c15-f5e8-4358-a2a0-a4650fbb3866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.079675 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9c15-f5e8-4358-a2a0-a4650fbb3866 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.079926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9c15-f5e8-4358-a2a0-a4650fbb3866 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.080205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9c15-f5e8-4358-a2a0-a4650fbb3866 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.080866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a9c15-f5e8-4358-a2a0-a4650fbb3866 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.082225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a9c15-f5e8-4358-a2a0-a4650fbb3866 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.099904 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 496/999] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:30:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:30:56.137251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ca8b-4633-490f-8209-201eb791f3ef None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.182666 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.183292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.183574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.183878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.184518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:56.184822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.186214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.197209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 504/1000] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:56.199129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a9c15-f5e8-4358-a2a0-a4650fbb3866 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.311436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a9c15-f5e8-4358-a2a0-a4650fbb3866 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.340578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.351702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec51445-c228-4952-b230-1af68a834f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.352588 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51445-c228-4952-b230-1af68a834f6d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.353023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51445-c228-4952-b230-1af68a834f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.353477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec51445-c228-4952-b230-1af68a834f6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.354361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51445-c228-4952-b230-1af68a834f6d None admin] RBAC: Adding query filter params (interface=public, service_id=0be4a1a53303473ca1d5fadaa35676ed, region_id=RegionOne) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:56.354820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51445-c228-4952-b230-1af68a834f6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.356362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec51445-c228-4952-b230-1af68a834f6d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.366426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 497/1001] 10.222.0.55 () {56 vars in 1251 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/endpoints?service_id=0be4a1a53303473ca1d5fadaa35676ed&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:30:56.368352 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:56.400541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:56.482414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d70b7-192c-4e39-a080-83a8183dc8e0 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:56.515924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d6561-c2f5-45bb-8274-6f1106a7a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:56.516544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d6561-c2f5-45bb-8274-6f1106a7a9de None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:56.516814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d6561-c2f5-45bb-8274-6f1106a7a9de None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:56.517087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d6561-c2f5-45bb-8274-6f1106a7a9de None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:56.517679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d6561-c2f5-45bb-8274-6f1106a7a9de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:56.519041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d6561-c2f5-45bb-8274-6f1106a7a9de None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:56.531858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 505/1002] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:30:56 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:30:57.169364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77f3dd-a70f-44e7-a262-4a7d1265a930 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.169892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77f3dd-a70f-44e7-a262-4a7d1265a930 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.169892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77f3dd-a70f-44e7-a262-4a7d1265a930 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.171428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 498/1003] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:57.176433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88386-f7ef-4cbd-b151-b9446bf6bcac None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.177331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88386-f7ef-4cbd-b151-b9446bf6bcac None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.177500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b88386-f7ef-4cbd-b151-b9446bf6bcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.195796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b1b88386-f7ef-4cbd-b151-b9446bf6bcac None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:57.197037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b1b88386-f7ef-4cbd-b151-b9446bf6bcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:57.264668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 506/1004] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:57.532567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77f3dd-a70f-44e7-a262-4a7d1265a930 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.636726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77f3dd-a70f-44e7-a262-4a7d1265a930 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.670971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.671603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.671915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.672190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] PATH_INFO: `/v3/services/image` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.672765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.674167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:57.683019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:57.684045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:30:57.684899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:30:57.688157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 499/1005] 10.222.0.55 () {56 vars in 1105 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:57.689912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b88386-f7ef-4cbd-b151-b9446bf6bcac None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.715323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.792415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b88386-f7ef-4cbd-b151-b9446bf6bcac None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.825681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656fc58-0403-4854-9774-77c5e7175895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.826283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fc58-0403-4854-9774-77c5e7175895 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.826560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fc58-0403-4854-9774-77c5e7175895 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.826828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fc58-0403-4854-9774-77c5e7175895 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.827447 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656fc58-0403-4854-9774-77c5e7175895 None admin] RBAC: Adding query filter params (name=image) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:57.827744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656fc58-0403-4854-9774-77c5e7175895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.829131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656fc58-0403-4854-9774-77c5e7175895 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.834487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 507/1006] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:57.840109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:57.897775 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:57.943509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfcfc8-e406-4775-8a4c-99752c7d4e2c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:57.983825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f81774-77e0-4c91-b59c-89d8d832936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:57.983825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f81774-77e0-4c91-b59c-89d8d832936e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:57.983825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f81774-77e0-4c91-b59c-89d8d832936e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:57.983825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f81774-77e0-4c91-b59c-89d8d832936e None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:57.984233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f81774-77e0-4c91-b59c-89d8d832936e None admin] RBAC: Adding query filter params (type=image) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:57.984233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f81774-77e0-4c91-b59c-89d8d832936e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:57.984233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f81774-77e0-4c91-b59c-89d8d832936e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:57.988450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 500/1007] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:58.041213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e5f26-9061-480a-ad31-e190a1c68ef8 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.041493 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e5f26-9061-480a-ad31-e190a1c68ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.041772 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e5f26-9061-480a-ad31-e190a1c68ef8 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.043406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 508/1008] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:58.048868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62b9a0-592b-4753-b701-cdfbbdcc69e4 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.049174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62b9a0-592b-4753-b701-cdfbbdcc69e4 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.049432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62b9a0-592b-4753-b701-cdfbbdcc69e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.069360 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-ea62b9a0-592b-4753-b701-cdfbbdcc69e4 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:58.070575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ea62b9a0-592b-4753-b701-cdfbbdcc69e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:58.146984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 501/1009] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:30:58.412266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e5f26-9061-480a-ad31-e190a1c68ef8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.442783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a036c-5aaa-42e1-8e0f-551f5de1c8dc None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.443318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a036c-5aaa-42e1-8e0f-551f5de1c8dc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.443318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a036c-5aaa-42e1-8e0f-551f5de1c8dc None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.444854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 502/1010] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:30:58.449418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6394f-4f6d-48f7-85d8-0298d2de760b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.449710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6394f-4f6d-48f7-85d8-0298d2de760b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.450099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6394f-4f6d-48f7-85d8-0298d2de760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.468216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c7d6394f-4f6d-48f7-85d8-0298d2de760b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:58.469397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c7d6394f-4f6d-48f7-85d8-0298d2de760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:30:58.506023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.523035 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e5f26-9061-480a-ad31-e190a1c68ef8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.527949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:58.554599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 503/1011] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:30:58.566912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c052-330f-4ad0-bf1a-9e5569f8ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.567547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c052-330f-4ad0-bf1a-9e5569f8ba39 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.567857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c052-330f-4ad0-bf1a-9e5569f8ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.568130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c052-330f-4ad0-bf1a-9e5569f8ba39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.569229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4c052-330f-4ad0-bf1a-9e5569f8ba39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.570694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4c052-330f-4ad0-bf1a-9e5569f8ba39 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.572462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 509/1012] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:58.577962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6394f-4f6d-48f7-85d8-0298d2de760b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.678987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6394f-4f6d-48f7-85d8-0298d2de760b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.711721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6598fc3-ff99-44f8-a78e-b6c004de2901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.712353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598fc3-ff99-44f8-a78e-b6c004de2901 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.712640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598fc3-ff99-44f8-a78e-b6c004de2901 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.712912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598fc3-ff99-44f8-a78e-b6c004de2901 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.713569 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6598fc3-ff99-44f8-a78e-b6c004de2901 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.714993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6598fc3-ff99-44f8-a78e-b6c004de2901 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.743828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 504/1013] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:30:58 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:30:58.827441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c052-330f-4ad0-bf1a-9e5569f8ba39 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:58.934950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c052-330f-4ad0-bf1a-9e5569f8ba39 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:58.974951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:58.975596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:58.975910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:58.976186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:58.976767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:58.978137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:30:58.987013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:30:58.988136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:30:58.989399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 510/1014] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:30:58.999682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6598fc3-ff99-44f8-a78e-b6c004de2901 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.031277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:59.107369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6598fc3-ff99-44f8-a78e-b6c004de2901 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.140936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.141936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.142419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.142891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.143732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:59.144219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.146561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.151988 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 505/1015] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:59.157630 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.177953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:59.266812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ffaa9-dd95-4147-9d90-6b9843feaf03 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.300666 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d882ed-ac38-4612-9f22-9927f9ab4b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.301305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d882ed-ac38-4612-9f22-9927f9ab4b61 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.301586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d882ed-ac38-4612-9f22-9927f9ab4b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.301860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d882ed-ac38-4612-9f22-9927f9ab4b61 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.302481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d882ed-ac38-4612-9f22-9927f9ab4b61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:30:59.302782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d882ed-ac38-4612-9f22-9927f9ab4b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.304253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d882ed-ac38-4612-9f22-9927f9ab4b61 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.309274 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 511/1016] 10.222.0.55 () {56 vars in 1112 bytes} [Thu Sep 1 15:30:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:30:59.314741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:30:59.413298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:30:59.421201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd211c2-d8d6-49da-9bb0-edda7af5b143 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:30:59.455054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a730bf6-3b2d-445f-9d3c-724a14105103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:30:59.455678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730bf6-3b2d-445f-9d3c-724a14105103 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.455971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730bf6-3b2d-445f-9d3c-724a14105103 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.456248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730bf6-3b2d-445f-9d3c-724a14105103 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.456932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a730bf6-3b2d-445f-9d3c-724a14105103 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:30:59.458852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a730bf6-3b2d-445f-9d3c-724a14105103 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:30:59.487809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 506/1017] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:30:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:30:59.900736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce172-22db-4b0b-adf7-767a119179c2 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.901256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce172-22db-4b0b-adf7-767a119179c2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.901376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce172-22db-4b0b-adf7-767a119179c2 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.902670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 512/1018] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:30:59.907661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94ccc9-6c07-49bd-8bd0-5c487c03e490 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:30:59.907990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94ccc9-6c07-49bd-8bd0-5c487c03e490 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:30:59.908273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94ccc9-6c07-49bd-8bd0-5c487c03e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:30:59.926815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-dc94ccc9-6c07-49bd-8bd0-5c487c03e490 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:30:59.928030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-dc94ccc9-6c07-49bd-8bd0-5c487c03e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:00.008589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 507/1019] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:30:59 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:00.275235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce172-22db-4b0b-adf7-767a119179c2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:00.359109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:00.379903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce172-22db-4b0b-adf7-767a119179c2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:00.414032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035578d9-bf01-4250-b43e-14e4017160db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:00.414636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035578d9-bf01-4250-b43e-14e4017160db None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.414912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035578d9-bf01-4250-b43e-14e4017160db None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.415180 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035578d9-bf01-4250-b43e-14e4017160db None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.415846 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035578d9-bf01-4250-b43e-14e4017160db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:00.417205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035578d9-bf01-4250-b43e-14e4017160db None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:00.435838 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 513/1020] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:00 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:00.685050 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed9e29-39c3-4e97-86fb-c3bcd90e0d46 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.685576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed9e29-39c3-4e97-86fb-c3bcd90e0d46 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.685676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed9e29-39c3-4e97-86fb-c3bcd90e0d46 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.687101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 508/1021] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:00.692587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b30d28-2f8d-44e3-9b22-9d685b2e61b2 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:00.692878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b30d28-2f8d-44e3-9b22-9d685b2e61b2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:00.693151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b30d28-2f8d-44e3-9b22-9d685b2e61b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:00.711508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-40b30d28-2f8d-44e3-9b22-9d685b2e61b2 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:00.712712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-40b30d28-2f8d-44e3-9b22-9d685b2e61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:00.783943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 514/1022] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:01.054354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed9e29-39c3-4e97-86fb-c3bcd90e0d46 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:01.132539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:01.158035 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed9e29-39c3-4e97-86fb-c3bcd90e0d46 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:01.191711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd01ad7-9452-4751-b412-5ff148d95e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:01.193035 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd01ad7-9452-4751-b412-5ff148d95e0e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.193314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd01ad7-9452-4751-b412-5ff148d95e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.193585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd01ad7-9452-4751-b412-5ff148d95e0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.194707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd01ad7-9452-4751-b412-5ff148d95e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:01.196177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd01ad7-9452-4751-b412-5ff148d95e0e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:01.197923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 509/1023] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:01.203464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b30d28-2f8d-44e3-9b22-9d685b2e61b2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:01.267662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:01.303759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b30d28-2f8d-44e3-9b22-9d685b2e61b2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:01.337103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ee57-1cb9-4b2c-bff9-fd444510ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:01.337719 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ee57-1cb9-4b2c-bff9-fd444510ddec None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.337996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ee57-1cb9-4b2c-bff9-fd444510ddec None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.338266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ee57-1cb9-4b2c-bff9-fd444510ddec None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.338915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ee57-1cb9-4b2c-bff9-fd444510ddec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:01.340408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521ee57-1cb9-4b2c-bff9-fd444510ddec None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:01.362979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 515/1024] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:31:01 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:01.503962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f709188-d752-4700-a22f-aac8c414701a None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.504297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f709188-d752-4700-a22f-aac8c414701a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.504579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f709188-d752-4700-a22f-aac8c414701a None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.505946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 510/1025] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:01.511438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aab4f-3607-42fd-93d5-7f5813d4b8e2 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:01.511750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aab4f-3607-42fd-93d5-7f5813d4b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:01.512078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aab4f-3607-42fd-93d5-7f5813d4b8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:01.532404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-432aab4f-3607-42fd-93d5-7f5813d4b8e2 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:01.533545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-432aab4f-3607-42fd-93d5-7f5813d4b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:01.615460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 516/1026] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:01.880833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f709188-d752-4700-a22f-aac8c414701a None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:01.994878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f709188-d752-4700-a22f-aac8c414701a None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.029291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2a83-98d6-4005-b073-264398294b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.029925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2a83-98d6-4005-b073-264398294b2c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.030208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2a83-98d6-4005-b073-264398294b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.030483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d2a83-98d6-4005-b073-264398294b2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.041180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d2a83-98d6-4005-b073-264398294b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-672d2a83-98d6-4005-b073-264398294b2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:02.046181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:02.047094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:02.047980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 511/1027] 10.222.0.55 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:02.053273 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aab4f-3607-42fd-93d5-7f5813d4b8e2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.109972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.156304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aab4f-3607-42fd-93d5-7f5813d4b8e2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.189343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed220-7a10-4402-a272-df12683e37d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.189951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed220-7a10-4402-a272-df12683e37d1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.190232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed220-7a10-4402-a272-df12683e37d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.190505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed220-7a10-4402-a272-df12683e37d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.191169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aed220-7a10-4402-a272-df12683e37d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:02.191471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aed220-7a10-4402-a272-df12683e37d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.193413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aed220-7a10-4402-a272-df12683e37d1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.206044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 517/1028] 10.222.0.55 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:02.208786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2a83-98d6-4005-b073-264398294b2c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.213293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.312448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d2a83-98d6-4005-b073-264398294b2c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.348065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.348928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.349360 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.349807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.355152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c224c6-485c-4e61-9de0-a52d26595846 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.355438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c224c6-485c-4e61-9de0-a52d26595846 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.355717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c224c6-485c-4e61-9de0-a52d26595846 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.357299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 518/1029] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:02.360906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.361769 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd1e0-2964-45f1-a3ab-40bc58d2c685 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.362055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd1e0-2964-45f1-a3ab-40bc58d2c685 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.362327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbd1e0-2964-45f1-a3ab-40bc58d2c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.363163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:02.379989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:02.380990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:02.381892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:02.381892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:02.381892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:02.381892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 512/1030] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:02.384677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-0bcbd1e0-2964-45f1-a3ab-40bc58d2c685 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:02.386056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-0bcbd1e0-2964-45f1-a3ab-40bc58d2c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:02.386905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.448392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.462838 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 519/1031] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:02.495452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648cec6-b0eb-4afc-81ab-464ec39041f4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.531531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.532202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.532482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.532754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.533425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:02.533734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.535139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.553074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 513/1032] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:02.554848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd1e0-2964-45f1-a3ab-40bc58d2c685 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.603021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.659222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbd1e0-2964-45f1-a3ab-40bc58d2c685 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.693638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.694271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.694554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.694832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.701835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.703313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:02.714891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:02.715860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:02.716864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:02.720089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 520/1033] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:02.721822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.746723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.827084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4657d5-9339-4379-a725-b256f7fa04ad None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.845960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.854491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf072-d997-42de-80c1-5a60fc44c5c8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:02.861906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:02.865398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.866015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.866297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.866573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.867323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:02.867638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.869161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.890100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 514/1034] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:02.895630 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:02.897752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:02.898555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:02.899003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:02.899419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] PATH_INFO: `/v3/services/image` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:02.900190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:02.901589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:02.910710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:02.911741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:02.913392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 521/1035] 10.222.0.55 () {56 vars in 1105 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:02.917900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.009997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba215e46-2793-4967-9fb0-d2ae7ec3a5d3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.029108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8444-9ca2-4420-a9a5-c7dbadfa9dac None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.044605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5bc8f-4894-44f0-b3a0-229767fcc86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.045223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5bc8f-4894-44f0-b3a0-229767fcc86b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.045502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5bc8f-4894-44f0-b3a0-229767fcc86b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.045780 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5bc8f-4894-44f0-b3a0-229767fcc86b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.066070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.066848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.067396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.067759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.068519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] RBAC: Adding query filter params (name=image) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.068930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.070524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.080100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 522/1036] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:03.081568 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.093109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.117401 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.125011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5bc8f-4894-44f0-b3a0-229767fcc86b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.126471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5bc8f-4894-44f0-b3a0-229767fcc86b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.193231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaefed-fdab-46da-8551-c79cf7682f86 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.231756 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.232498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.232598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.232856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.233625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 515/1037] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:31:03.233740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] RBAC: Adding query filter params (type=image) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.236168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.237591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.239805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5bc8f-4894-44f0-b3a0-229767fcc86b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.248251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 523/1038] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:03.249994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.316886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.344776 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5bc8f-4894-44f0-b3a0-229767fcc86b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.355127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.359234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33604dbb-83df-41ad-8ff4-6e27b5b91a3b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.381124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de956489-1f66-4055-b7a0-67fab83d517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.381762 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de956489-1f66-4055-b7a0-67fab83d517d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.382045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de956489-1f66-4055-b7a0-67fab83d517d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.382320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de956489-1f66-4055-b7a0-67fab83d517d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.392138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de956489-1f66-4055-b7a0-67fab83d517d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.393549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44394af7-8db0-4f42-8e3a-ce6d897ad70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.393692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de956489-1f66-4055-b7a0-67fab83d517d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.394158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394af7-8db0-4f42-8e3a-ce6d897ad70a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.394441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394af7-8db0-4f42-8e3a-ce6d897ad70a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.394719 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394af7-8db0-4f42-8e3a-ce6d897ad70a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.395966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44394af7-8db0-4f42-8e3a-ce6d897ad70a None admin] RBAC: Adding query filter params (interface=public, service_id=ab9d76059954401d99ec7b9dfbd0aaa3, region_id=RegionOne) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.396276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44394af7-8db0-4f42-8e3a-ce6d897ad70a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.397941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44394af7-8db0-4f42-8e3a-ce6d897ad70a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.402962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 524/1039] 10.222.0.55 () {56 vars in 1251 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/endpoints?service_id=ab9d76059954401d99ec7b9dfbd0aaa3&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:03.404113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230826cb-3e58-411f-ba52-e492527b5f05 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.404404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230826cb-3e58-411f-ba52-e492527b5f05 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.404678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230826cb-3e58-411f-ba52-e492527b5f05 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.406013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 525/1040] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:03.408454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230826cb-3e58-411f-ba52-e492527b5f05 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-de956489-1f66-4055-b7a0-67fab83d517d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:03.409717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:03.411422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:03.412552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:03.412552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:03.412552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:03.412552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 516/1041] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:03.412552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37657e48-2c2b-4197-a615-e5fd434571e0 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.412901 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37657e48-2c2b-4197-a615-e5fd434571e0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.413076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37657e48-2c2b-4197-a615-e5fd434571e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.430642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-37657e48-2c2b-4197-a615-e5fd434571e0 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:03.431835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-37657e48-2c2b-4197-a615-e5fd434571e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:03.497644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 517/1042] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:03.498381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37657e48-2c2b-4197-a615-e5fd434571e0 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.520432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230826cb-3e58-411f-ba52-e492527b5f05 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.554914 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f8fe-e663-435c-bf28-14fea8a83970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.555525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f8fe-e663-435c-bf28-14fea8a83970 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.556063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f8fe-e663-435c-bf28-14fea8a83970 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.556175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f8fe-e663-435c-bf28-14fea8a83970 None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.556684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605f8fe-e663-435c-bf28-14fea8a83970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.558051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605f8fe-e663-435c-bf28-14fea8a83970 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.559767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.565464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 526/1043] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:31:03.621097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37657e48-2c2b-4197-a615-e5fd434571e0 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.658628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.659252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.659531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.659848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.661125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:03.661426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.662863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.679868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 518/1044] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:03.681214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f8fe-e663-435c-bf28-14fea8a83970 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.712741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.767855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.794029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f8fe-e663-435c-bf28-14fea8a83970 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.830792 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.831420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.831712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.832005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.839558 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:03.841050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:03.852392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:03.853276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:03.854163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 527/1045] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:03.859598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.878010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374dea5-a071-4fa7-b8d7-1a849fca57e3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:03.896192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.917131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67007212-900d-48c1-a8d7-df68e31640f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:03.917771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67007212-900d-48c1-a8d7-df68e31640f9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:03.918055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67007212-900d-48c1-a8d7-df68e31640f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:03.918332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67007212-900d-48c1-a8d7-df68e31640f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:03.929146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67007212-900d-48c1-a8d7-df68e31640f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-67007212-900d-48c1-a8d7-df68e31640f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:03.934369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:03.935303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:03.936175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 519/1046] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:03.941303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67007212-900d-48c1-a8d7-df68e31640f9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:03.964356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:03.978986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f48279-b89b-4fe6-bb7c-e557e09da0cb None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.016307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.016925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.017227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.017491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.018222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:04.018556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.020473 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.033842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 528/1047] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:04.039616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:04.065013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67007212-900d-48c1-a8d7-df68e31640f9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.099904 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.100524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.100812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.101092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.101761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:04.102069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.103438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.112414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 520/1048] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:04.118988 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:04.147196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578cfb7-b8e4-44d3-8574-982ac05dae1b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.160236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:04.185294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.185908 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.186190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.186465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.187202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] RBAC: Adding query filter params (role.id=ba4aa4f0a48640afab0266b6b2d880c6, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=9fbf473d168b4c9692f75a51c84b7db7) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:04.187513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.188997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.195136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 529/1049] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/role_assignments?user.id=9fbf473d168b4c9692f75a51c84b7db7&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=ba4aa4f0a48640afab0266b6b2d880c6 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:04.226101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1e7b0-28ea-467c-869f-db6c65cf90c4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.265898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc65f-67a1-4b76-80a6-7d5ec30c7e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.266549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc65f-67a1-4b76-80a6-7d5ec30c7e76 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.266829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc65f-67a1-4b76-80a6-7d5ec30c7e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.267130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cc65f-67a1-4b76-80a6-7d5ec30c7e76 None admin] PATH_INFO: `/v3/users/c9a6952df4b047e881b764cddce46d31` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.282675 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cc65f-67a1-4b76-80a6-7d5ec30c7e76 None admin] RBAC: Authorizing `identity:get_user(user_id=c9a6952df4b047e881b764cddce46d31)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.284153 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cc65f-67a1-4b76-80a6-7d5ec30c7e76 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.286105 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 521/1050] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/users/c9a6952df4b047e881b764cddce46d31 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:04.291985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:04.307216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:04.399927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248b4e-c6fa-4ba5-973e-d37bebce0b1e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.433412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b91e-6ce3-48dc-95f2-8c44d33f1253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.434027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b91e-6ce3-48dc-95f2-8c44d33f1253 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.434307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b91e-6ce3-48dc-95f2-8c44d33f1253 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.434580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1b91e-6ce3-48dc-95f2-8c44d33f1253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.501701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1b91e-6ce3-48dc-95f2-8c44d33f1253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.503170 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1b91e-6ce3-48dc-95f2-8c44d33f1253 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.521050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:04.620581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 530/1051] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:04.622420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc65f-67a1-4b76-80a6-7d5ec30c7e76 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:04.719371 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:04.726643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cc65f-67a1-4b76-80a6-7d5ec30c7e76 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.760307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a81b5-1b94-4fbf-89a9-b63f71edaa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.760940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a81b5-1b94-4fbf-89a9-b63f71edaa05 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.761217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a81b5-1b94-4fbf-89a9-b63f71edaa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.761489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a81b5-1b94-4fbf-89a9-b63f71edaa05 None admin] PATH_INFO: `/v3/projects/2b8f717182a34583b507683068a13dbe` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.762597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a81b5-1b94-4fbf-89a9-b63f71edaa05 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f717182a34583b507683068a13dbe)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.764043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a81b5-1b94-4fbf-89a9-b63f71edaa05 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.765829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 522/1052] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/projects/2b8f717182a34583b507683068a13dbe => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:04.771981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b91e-6ce3-48dc-95f2-8c44d33f1253 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:04.870810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1b91e-6ce3-48dc-95f2-8c44d33f1253 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:04.881148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:04.905501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600db7-7918-44d2-a341-616d05220cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:04.906103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600db7-7918-44d2-a341-616d05220cea None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:04.906379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600db7-7918-44d2-a341-616d05220cea None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:04.906646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600db7-7918-44d2-a341-616d05220cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:04.907360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600db7-7918-44d2-a341-616d05220cea None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=2b8f717182a34583b507683068a13dbe, user.id=c9a6952df4b047e881b764cddce46d31) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:04.907662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600db7-7918-44d2-a341-616d05220cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:04.909114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d600db7-7918-44d2-a341-616d05220cea None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:04.915255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 531/1053] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:04 2022] GET /identity/v3/role_assignments?user.id=c9a6952df4b047e881b764cddce46d31&scope.project.id=2b8f717182a34583b507683068a13dbe&role.id=32319452053845419798d329f1c194d4 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:05.513365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd8261-c1cf-4db7-aa2b-34aa540ccc0d None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.513897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd8261-c1cf-4db7-aa2b-34aa540ccc0d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.513897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd8261-c1cf-4db7-aa2b-34aa540ccc0d None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.515301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 523/1054] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:05.521255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271266-97cc-4cc1-af85-85e33f4b9b78 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:05.521916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271266-97cc-4cc1-af85-85e33f4b9b78 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:05.522060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271266-97cc-4cc1-af85-85e33f4b9b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:05.540176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3b271266-97cc-4cc1-af85-85e33f4b9b78 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:05.541368 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3b271266-97cc-4cc1-af85-85e33f4b9b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:05.607142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 532/1055] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:05.873697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd8261-c1cf-4db7-aa2b-34aa540ccc0d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:05.982223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd8261-c1cf-4db7-aa2b-34aa540ccc0d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.016725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a92d09-4f7e-444e-a2e7-a17396a296a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.017361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a92d09-4f7e-444e-a2e7-a17396a296a7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.017645 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a92d09-4f7e-444e-a2e7-a17396a296a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.017920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a92d09-4f7e-444e-a2e7-a17396a296a7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.018506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a92d09-4f7e-444e-a2e7-a17396a296a7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.019933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a92d09-4f7e-444e-a2e7-a17396a296a7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-e9a92d09-4f7e-444e-a2e7-a17396a296a7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:06.029092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:06.030059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 15:31:06.030893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:06.032343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 524/1056] 10.222.0.55 () {56 vars in 1105 bytes} [Thu Sep 1 15:31:05 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:06.036700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271266-97cc-4cc1-af85-85e33f4b9b78 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.078560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93165af3-3561-44ee-b41e-2af43d1d6591 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.078841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93165af3-3561-44ee-b41e-2af43d1d6591 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.079119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93165af3-3561-44ee-b41e-2af43d1d6591 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.080511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 525/1057] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:06.085653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a283c2-b640-4ca6-89b3-40016f371781 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.085933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a283c2-b640-4ca6-89b3-40016f371781 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.086206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a283c2-b640-4ca6-89b3-40016f371781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.104827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-65a283c2-b640-4ca6-89b3-40016f371781 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:06.106013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-65a283c2-b640-4ca6-89b3-40016f371781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:06.129281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.145719 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271266-97cc-4cc1-af85-85e33f4b9b78 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.148868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.178502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 526/1058] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:06.182544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.183156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.183438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.183710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.184381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] RBAC: Adding query filter params (name=image) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:06.184690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.186094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.191126 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 533/1059] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:06.197290 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a283c2-b640-4ca6-89b3-40016f371781 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.295266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a283c2-b640-4ca6-89b3-40016f371781 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.329330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.329938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.330220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.330498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.331133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] RBAC: Adding query filter params (type=image) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:06.331444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.333404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.342977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 527/1060] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:06.344318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.445288 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdb188-e84c-4d8d-b072-a7f6551bc1ad None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.459569 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.480491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04550-6b7b-489a-887b-5fc88b102065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.481331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04550-6b7b-489a-887b-5fc88b102065 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.481762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04550-6b7b-489a-887b-5fc88b102065 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.482195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04550-6b7b-489a-887b-5fc88b102065 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.482858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a04550-6b7b-489a-887b-5fc88b102065 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.484278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a04550-6b7b-489a-887b-5fc88b102065 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.485041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.507816 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 534/1061] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:31:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:31:06.576537 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11437c9-924c-4ec3-8827-77b14299730e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.621131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252f666-9e8f-4efc-91b2-c4d564f7f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.621774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f666-9e8f-4efc-91b2-c4d564f7f2bf None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.622051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f666-9e8f-4efc-91b2-c4d564f7f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.622323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252f666-9e8f-4efc-91b2-c4d564f7f2bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.633972 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252f666-9e8f-4efc-91b2-c4d564f7f2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d252f666-9e8f-4efc-91b2-c4d564f7f2bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:06.639074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:06.640258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:06.641111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 528/1062] 10.222.0.55 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:06.648081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04550-6b7b-489a-887b-5fc88b102065 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.676433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.754653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04550-6b7b-489a-887b-5fc88b102065 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.785767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197117e-1ff2-40f9-af75-c67d5b8e3d6b None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.787308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197117e-1ff2-40f9-af75-c67d5b8e3d6b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.787597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197117e-1ff2-40f9-af75-c67d5b8e3d6b None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.788788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.789231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 529/1063] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:06.789413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.789686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.790003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.790664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:06.790973 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.792383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.793992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8d3d-9659-4e07-8787-fe9fdfb182d5 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.794274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8d3d-9659-4e07-8787-fe9fdfb182d5 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.794548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8d3d-9659-4e07-8787-fe9fdfb182d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.801810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 535/1064] 10.222.0.55 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:06.806959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.814571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-f7cf8d3d-9659-4e07-8787-fe9fdfb182d5 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:06.815763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f7cf8d3d-9659-4e07-8787-fe9fdfb182d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:06.891824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 530/1065] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:06.895364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:06.911687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4b149-5d60-4fd2-992f-758128b6ec1f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:06.947487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:06.948159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:06.951265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:06.951265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:06.963945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:06.965409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:06.980296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:06.981278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:06.982498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:06.982498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:06.982498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:06.982498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 536/1066] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:06.989147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8d3d-9659-4e07-8787-fe9fdfb182d5 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:06.999766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.091489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8d3d-9659-4e07-8787-fe9fdfb182d5 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.124804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.125408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.125685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.125954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.126593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.126894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.128326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.144562 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 531/1067] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.145884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.158234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.225449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.257760 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043842-894e-4ad8-9a2f-2d03ff834415 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.262239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791be087-8c70-47bd-aa33-47a62f22502f None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.297321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680307c-c68c-49dd-813c-ea3e4f0088ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.297989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680307c-c68c-49dd-813c-ea3e4f0088ee None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.298235 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680307c-c68c-49dd-813c-ea3e4f0088ee None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.298511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680307c-c68c-49dd-813c-ea3e4f0088ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.299308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.299959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.300235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.300649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.309472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.309909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680307c-c68c-49dd-813c-ea3e4f0088ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:07.310911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.312750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-8680307c-c68c-49dd-813c-ea3e4f0088ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:07.314738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:07.320220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:07.321095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 532/1068] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:07.322753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680307c-c68c-49dd-813c-ea3e4f0088ee None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:07.323411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:07.324506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:07.325580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:07.331930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 537/1069] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:07.334012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.432128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680307c-c68c-49dd-813c-ea3e4f0088ee None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.442125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeadebf-2512-441d-af6b-e7dde2ff71a5 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.458057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.466444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.467055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.467337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.467623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.468322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.468633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.470003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.479273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 533/1070] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.480537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.481225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.481575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.481915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.482714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.483024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.484486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.484950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.503266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 538/1071] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.508532 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.567587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.596043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de8018-ceb7-4717-bf44-b687c5d14603 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.614891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d539cd8-2357-4851-8691-7d6fdf619c16 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.635005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27206c3-7501-4348-9817-98153793afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.635641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27206c3-7501-4348-9817-98153793afc7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.635948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27206c3-7501-4348-9817-98153793afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.636220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27206c3-7501-4348-9817-98153793afc7 None admin] PATH_INFO: `/v3/users/c9a6952df4b047e881b764cddce46d31` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.637367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27206c3-7501-4348-9817-98153793afc7 None admin] RBAC: Authorizing `identity:get_user(user_id=c9a6952df4b047e881b764cddce46d31)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.638796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27206c3-7501-4348-9817-98153793afc7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.640414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 534/1072] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/users/c9a6952df4b047e881b764cddce46d31 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:07.646164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27206c3-7501-4348-9817-98153793afc7 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.658029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.658663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.658938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.659242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.672640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.674410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:07.689418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:07.690566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:07.691511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:07.691511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:07.691511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:07.691511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 539/1073] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:07.696526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.712761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.762259 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27206c3-7501-4348-9817-98153793afc7 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.799435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f3154-d883-463b-ae12-13833c8332dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.800098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f3154-d883-463b-ae12-13833c8332dc None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.800384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f3154-d883-463b-ae12-13833c8332dc None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.800660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f3154-d883-463b-ae12-13833c8332dc None admin] PATH_INFO: `/v3/projects/2b8f717182a34583b507683068a13dbe` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.801545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede5a3b-160e-4eb2-a83d-54a692d37dcf None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.802345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f3154-d883-463b-ae12-13833c8332dc None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f717182a34583b507683068a13dbe)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.804443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f3154-d883-463b-ae12-13833c8332dc None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.805617 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 535/1074] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/projects/2b8f717182a34583b507683068a13dbe => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.811014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.811661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f3154-d883-463b-ae12-13833c8332dc None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.837794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.838514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.838818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.839168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.839829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:07.840135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.841498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.859634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 540/1075] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:07.860634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:07.917991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f3154-d883-463b-ae12-13833c8332dc None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.946230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:07.962053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1c266-ec5a-4df8-9356-567b8e52bb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:07.963122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c266-ec5a-4df8-9356-567b8e52bb93 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:07.963900 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c266-ec5a-4df8-9356-567b8e52bb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:07.964609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c266-ec5a-4df8-9356-567b8e52bb93 None admin] PATH_INFO: `/v3/projects/2b8f717182a34583b507683068a13dbe/users/c9a6952df4b047e881b764cddce46d31/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:07.967414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1c266-ec5a-4df8-9356-567b8e52bb93 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8f717182a34583b507683068a13dbe, user_id=c9a6952df4b047e881b764cddce46d31, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:07.969067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1c266-ec5a-4df8-9356-567b8e52bb93 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:07.969177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69fb09-729c-4b69-bce8-4f2d44ed3a29 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:07.984427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 536/1076] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:07 2022] PUT /identity/v3/projects/2b8f717182a34583b507683068a13dbe/users/c9a6952df4b047e881b764cddce46d31/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:31:08.013127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.013791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.014073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.014350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.023072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.024661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:08.038444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:08.039465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:08.040399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 541/1077] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:08.045538 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1c266-ec5a-4df8-9356-567b8e52bb93 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.157529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1c266-ec5a-4df8-9356-567b8e52bb93 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.193358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b01c7b-cbd5-47ae-84e9-1a8468ce2c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.193975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b01c7b-cbd5-47ae-84e9-1a8468ce2c87 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.194257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b01c7b-cbd5-47ae-84e9-1a8468ce2c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.194530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b01c7b-cbd5-47ae-84e9-1a8468ce2c87 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.195230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b01c7b-cbd5-47ae-84e9-1a8468ce2c87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:08.195539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b01c7b-cbd5-47ae-84e9-1a8468ce2c87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.197058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b01c7b-cbd5-47ae-84e9-1a8468ce2c87 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.214125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 537/1078] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:08.215382 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.244013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.318113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e52a04-2052-4ea1-bd7c-24c49abdb7e8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.351792 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fa592-79cd-4034-a4ff-490446a2246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.352457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa592-79cd-4034-a4ff-490446a2246a None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.352741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa592-79cd-4034-a4ff-490446a2246a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.353024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa592-79cd-4034-a4ff-490446a2246a None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/9fbf473d168b4c9692f75a51c84b7db7/roles/ba4aa4f0a48640afab0266b6b2d880c6` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.355141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fa592-79cd-4034-a4ff-490446a2246a None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=9fbf473d168b4c9692f75a51c84b7db7, role_id=ba4aa4f0a48640afab0266b6b2d880c6)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:08.356623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fa592-79cd-4034-a4ff-490446a2246a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:08.379803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 542/1079] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:08 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/9fbf473d168b4c9692f75a51c84b7db7/roles/ba4aa4f0a48640afab0266b6b2d880c6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:31:08.464432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82baf-08c5-4909-84f5-45202740e8cb None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.464620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82baf-08c5-4909-84f5-45202740e8cb None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.464895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82baf-08c5-4909-84f5-45202740e8cb None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.466266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 538/1080] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:08.471692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e8c3e-b8f7-4deb-9701-16d61097d02d None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.472012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e8c3e-b8f7-4deb-9701-16d61097d02d None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.472293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e8c3e-b8f7-4deb-9701-16d61097d02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:08.491372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-cc5e8c3e-b8f7-4deb-9701-16d61097d02d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:08.492619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-cc5e8c3e-b8f7-4deb-9701-16d61097d02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:08.565155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 543/1081] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:08.830375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82baf-08c5-4909-84f5-45202740e8cb None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:08.879478 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:08.935545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82baf-08c5-4909-84f5-45202740e8cb None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:08.976943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc861d-9810-4538-8950-59378f7103b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:08.977561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc861d-9810-4538-8950-59378f7103b6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:08.977844 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc861d-9810-4538-8950-59378f7103b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:08.978122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc861d-9810-4538-8950-59378f7103b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.048199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc861d-9810-4538-8950-59378f7103b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.049651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc861d-9810-4538-8950-59378f7103b6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.096707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.151611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 539/1082] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:09.159816 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e8c3e-b8f7-4deb-9701-16d61097d02d None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.176048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.258402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e8c3e-b8f7-4deb-9701-16d61097d02d None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.291629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc442e0d-7a44-48bc-8852-43fa0e88d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.292283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc442e0d-7a44-48bc-8852-43fa0e88d18f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.292562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc442e0d-7a44-48bc-8852-43fa0e88d18f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.292831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc442e0d-7a44-48bc-8852-43fa0e88d18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.303069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc442e0d-7a44-48bc-8852-43fa0e88d18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.304543 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc442e0d-7a44-48bc-8852-43fa0e88d18f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-dc442e0d-7a44-48bc-8852-43fa0e88d18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:09.319564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:09.320782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:09.321704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:09.321704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:09.321704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:09.323926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 544/1083] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:09.326643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc861d-9810-4538-8950-59378f7103b6 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:09.431178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc861d-9810-4538-8950-59378f7103b6 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:09.467678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc6d5e-8fa3-492d-89e3-fd7efeb12932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:09.468336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc6d5e-8fa3-492d-89e3-fd7efeb12932 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.468622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc6d5e-8fa3-492d-89e3-fd7efeb12932 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.468899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc6d5e-8fa3-492d-89e3-fd7efeb12932 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.469550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc6d5e-8fa3-492d-89e3-fd7efeb12932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:09.469923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc6d5e-8fa3-492d-89e3-fd7efeb12932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:09.471303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc6d5e-8fa3-492d-89e3-fd7efeb12932 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:09.491820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 540/1084] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:09.910692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b265-78c0-45a5-aa88-cbeff1a72c4c None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.910971 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b265-78c0-45a5-aa88-cbeff1a72c4c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.911151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b265-78c0-45a5-aa88-cbeff1a72c4c None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.912542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 545/1085] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:09.917826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eddd4-4ed7-4442-a5bf-16a8a79a4f45 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:09.918266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eddd4-4ed7-4442-a5bf-16a8a79a4f45 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:09.918355 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1eddd4-4ed7-4442-a5bf-16a8a79a4f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:09.931097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:09.936811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-1f1eddd4-4ed7-4442-a5bf-16a8a79a4f45 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:09.937987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1f1eddd4-4ed7-4442-a5bf-16a8a79a4f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:10.007787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 541/1086] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:10.271038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066b265-78c0-45a5-aa88-cbeff1a72c4c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.287222 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc959f8-cce5-4f74-9448-5743aa3bbcb2 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.287511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc959f8-cce5-4f74-9448-5743aa3bbcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.287811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc959f8-cce5-4f74-9448-5743aa3bbcb2 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.289167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 542/1087] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:31:10.294037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcdc37-6c7a-47da-bab9-6f51c1429516 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.294321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcdc37-6c7a-47da-bab9-6f51c1429516 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.294607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcdc37-6c7a-47da-bab9-6f51c1429516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.312654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-21fcdc37-6c7a-47da-bab9-6f51c1429516 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:10.313848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-21fcdc37-6c7a-47da-bab9-6f51c1429516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:10.343229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.376591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066b265-78c0-45a5-aa88-cbeff1a72c4c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.381170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 543/1088] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:31:10.409860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff5a69-647d-44e5-9a2d-8c6a047217a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.410487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a69-647d-44e5-9a2d-8c6a047217a9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.410774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a69-647d-44e5-9a2d-8c6a047217a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.411041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a69-647d-44e5-9a2d-8c6a047217a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.420814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff5a69-647d-44e5-9a2d-8c6a047217a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b1ff5a69-647d-44e5-9a2d-8c6a047217a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:10.426173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:10.427163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:10.428038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 546/1089] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:10.433224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcdc37-6c7a-47da-bab9-6f51c1429516 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.496832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.534706 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcdc37-6c7a-47da-bab9-6f51c1429516 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.568635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.569243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.569528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.569805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.570478 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:10.570785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.572189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.580014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 544/1090] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:10.585730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff5a69-647d-44e5-9a2d-8c6a047217a9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.648436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.682632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff5a69-647d-44e5-9a2d-8c6a047217a9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.711602 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.718309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0352-ddd1-4639-be71-d3eac7722af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.718941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0352-ddd1-4639-be71-d3eac7722af1 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.719221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0352-ddd1-4639-be71-d3eac7722af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.719499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0352-ddd1-4639-be71-d3eac7722af1 None admin] PATH_INFO: `/v3/users/c9a6952df4b047e881b764cddce46d31` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.720649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0352-ddd1-4639-be71-d3eac7722af1 None admin] RBAC: Authorizing `identity:get_user(user_id=c9a6952df4b047e881b764cddce46d31)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.722083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0352-ddd1-4639-be71-d3eac7722af1 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.724215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 547/1091] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/users/c9a6952df4b047e881b764cddce46d31 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:10.730097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0352-ddd1-4639-be71-d3eac7722af1 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.749493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ce50d-953e-45c6-8344-daeb6686585a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.774695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.782671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a252-cdd1-4642-a563-d1b8dffb4af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.783295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a252-cdd1-4642-a563-d1b8dffb4af8 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.783577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a252-cdd1-4642-a563-d1b8dffb4af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.783867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a252-cdd1-4642-a563-d1b8dffb4af8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.794644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5a252-cdd1-4642-a563-d1b8dffb4af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-3cc5a252-cdd1-4642-a563-d1b8dffb4af8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:10.799330 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:10.800512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:10.801996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 545/1092] 10.222.0.55 () {56 vars in 1120 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:10.806938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a252-cdd1-4642-a563-d1b8dffb4af8 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:10.828060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0352-ddd1-4639-be71-d3eac7722af1 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.861298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ad93b-47f3-40a4-8e9e-a248b9c50467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.861902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad93b-47f3-40a4-8e9e-a248b9c50467 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.862178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad93b-47f3-40a4-8e9e-a248b9c50467 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.862445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad93b-47f3-40a4-8e9e-a248b9c50467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.905095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a252-cdd1-4642-a563-d1b8dffb4af8 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:10.924670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:10.928998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ad93b-47f3-40a4-8e9e-a248b9c50467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.930716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ad93b-47f3-40a4-8e9e-a248b9c50467 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.938630 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04973-3470-45e0-b659-842d964214af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:10.939232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04973-3470-45e0-b659-842d964214af None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:10.939513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04973-3470-45e0-b659-842d964214af None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:10.939792 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04973-3470-45e0-b659-842d964214af None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:10.940539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f04973-3470-45e0-b659-842d964214af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:10.940841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f04973-3470-45e0-b659-842d964214af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:10.942184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f04973-3470-45e0-b659-842d964214af None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:10.950322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 546/1093] 10.222.0.55 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:10.955901 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04973-3470-45e0-b659-842d964214af None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.004673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.030539 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 548/1094] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:31:11.036911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ad93b-47f3-40a4-8e9e-a248b9c50467 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.054838 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04973-3470-45e0-b659-842d964214af None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.087718 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.088363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.088639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.088913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.099590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.101088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:11.115038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:11.116170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:11.117057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:11.117057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:11.117057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:11.117057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 547/1095] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:11.122090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.129579 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.133716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ad93b-47f3-40a4-8e9e-a248b9c50467 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.170552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276b960-4c68-4793-8aa6-9ba258b5b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.171174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276b960-4c68-4793-8aa6-9ba258b5b946 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.171459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276b960-4c68-4793-8aa6-9ba258b5b946 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.171731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276b960-4c68-4793-8aa6-9ba258b5b946 None admin] PATH_INFO: `/v3/projects/2b8f717182a34583b507683068a13dbe` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.172868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276b960-4c68-4793-8aa6-9ba258b5b946 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f717182a34583b507683068a13dbe)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.174295 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276b960-4c68-4793-8aa6-9ba258b5b946 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.175945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 549/1096] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/projects/2b8f717182a34583b507683068a13dbe => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:11.181959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276b960-4c68-4793-8aa6-9ba258b5b946 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.222103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908bb0a-bacf-4752-b57f-75ea192ea8dd None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.224436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.256773 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.257378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.257664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.257941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.258578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:11.258880 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.260280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.272079 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 548/1097] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:11.277705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.280013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276b960-4c68-4793-8aa6-9ba258b5b946 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.313985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.314511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.314788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.315059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.315801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=2b8f717182a34583b507683068a13dbe, user.id=c9a6952df4b047e881b764cddce46d31) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:11.316104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.317533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.323008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 550/1098] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/role_assignments?user.id=c9a6952df4b047e881b764cddce46d31&scope.project.id=2b8f717182a34583b507683068a13dbe&role.id=32319452053845419798d329f1c194d4 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:11.382066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1d609-326b-444a-a182-daac156d18d9 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.419039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.419688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.419999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.420273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.428746 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.430229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:31:11.442713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:11.443943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:11.444894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 549/1099] 10.222.0.55 () {56 vars in 1093 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:31:11.449938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.481226 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.551327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7c25d-0485-4d27-aa42-3e67fc411008 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.583962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.584590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.584878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.585154 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.585889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:11.586197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.587639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.605200 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 551/1100] 10.222.0.55 () {56 vars in 1133 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:11.611177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:11.635386 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.709845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08f4b8-4927-405c-80de-05c4049665aa None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:11.742454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9dd1-908c-47ba-919f-9f1f5c108987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:11.743065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9dd1-908c-47ba-919f-9f1f5c108987 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:11.743347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9dd1-908c-47ba-919f-9f1f5c108987 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:11.743622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9dd1-908c-47ba-919f-9f1f5c108987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:11.810719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9dd1-908c-47ba-919f-9f1f5c108987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:11.812193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9dd1-908c-47ba-919f-9f1f5c108987 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:11.835324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:11.909806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 550/1101] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:11.916529 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.005364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.017912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ffb54-6924-483c-898f-caed8c67f56a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.050857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.051480 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.051763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.052069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.061673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.063124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:12.077849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:12.078947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:31:12.079886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:12.079886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:31:12.079886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:12.079886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 552/1102] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:12.085543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9dd1-908c-47ba-919f-9f1f5c108987 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.181546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9dd1-908c-47ba-919f-9f1f5c108987 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.204001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.216221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287060b-240d-4326-8608-f896d233f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.216829 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287060b-240d-4326-8608-f896d233f016 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.217111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287060b-240d-4326-8608-f896d233f016 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.217384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287060b-240d-4326-8608-f896d233f016 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.218021 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287060b-240d-4326-8608-f896d233f016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:12.218323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287060b-240d-4326-8608-f896d233f016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.219713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287060b-240d-4326-8608-f896d233f016 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.230610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 551/1103] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:12.236268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.333225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231a007-acdc-454b-9905-ff431e55ef3a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.365565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.366127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.366406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.366678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.373508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.374949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.377405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:31:12.387452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:12.388548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:12.389445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 553/1104] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:12.394418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287060b-240d-4326-8608-f896d233f016 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.495549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287060b-240d-4326-8608-f896d233f016 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.528836 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4834596-d363-4ac5-900f-6301d9923560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.529446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4834596-d363-4ac5-900f-6301d9923560 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.529729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4834596-d363-4ac5-900f-6301d9923560 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.530007 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4834596-d363-4ac5-900f-6301d9923560 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.530704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4834596-d363-4ac5-900f-6301d9923560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:12.531018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4834596-d363-4ac5-900f-6301d9923560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.533012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4834596-d363-4ac5-900f-6301d9923560 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.544927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 552/1105] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:12.551450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:12.650153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e4f51-58e6-4187-827d-f88484727a03 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:12.683225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b43cd-aeba-455c-a578-c0440bdb2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:12.683852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b43cd-aeba-455c-a578-c0440bdb2375 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:12.684139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b43cd-aeba-455c-a578-c0440bdb2375 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:12.684414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b43cd-aeba-455c-a578-c0440bdb2375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:12.685133 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b43cd-aeba-455c-a578-c0440bdb2375 None admin] RBAC: Adding query filter params (role.id=ba4aa4f0a48640afab0266b6b2d880c6, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=9fbf473d168b4c9692f75a51c84b7db7) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:12.685444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b43cd-aeba-455c-a578-c0440bdb2375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:12.686883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b43cd-aeba-455c-a578-c0440bdb2375 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:12.693108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 554/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:12 2022] GET /identity/v3/role_assignments?user.id=9fbf473d168b4c9692f75a51c84b7db7&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=ba4aa4f0a48640afab0266b6b2d880c6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:13.231845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacd4e4-705b-427e-8fb1-9d4317edf541 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.232335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacd4e4-705b-427e-8fb1-9d4317edf541 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.232335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacd4e4-705b-427e-8fb1-9d4317edf541 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.233648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 553/1107] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:13.239009 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4f29-6744-4186-bdb7-3e82d574d379 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.239358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4f29-6744-4186-bdb7-3e82d574d379 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.239697 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd4f29-6744-4186-bdb7-3e82d574d379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.257629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-58fd4f29-6744-4186-bdb7-3e82d574d379 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:13.258804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-58fd4f29-6744-4186-bdb7-3e82d574d379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:13.318579 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.328620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 555/1108] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:13.595373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacd4e4-705b-427e-8fb1-9d4317edf541 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.638262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:13.694717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacd4e4-705b-427e-8fb1-9d4317edf541 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.727491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f93d1-7cbe-459e-b6cb-d570a57255db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.728128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f93d1-7cbe-459e-b6cb-d570a57255db None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.728409 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f93d1-7cbe-459e-b6cb-d570a57255db None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.728683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f93d1-7cbe-459e-b6cb-d570a57255db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.729790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f93d1-7cbe-459e-b6cb-d570a57255db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.731216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f93d1-7cbe-459e-b6cb-d570a57255db None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.732793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 554/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:13.738485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4f29-6744-4186-bdb7-3e82d574d379 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:13.833995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd4f29-6744-4186-bdb7-3e82d574d379 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:13.865915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541229b-eb03-4266-a63b-9ad0fcedefab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:13.866451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541229b-eb03-4266-a63b-9ad0fcedefab None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:13.866726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541229b-eb03-4266-a63b-9ad0fcedefab None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:13.866995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541229b-eb03-4266-a63b-9ad0fcedefab None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:13.867624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541229b-eb03-4266-a63b-9ad0fcedefab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:13.869066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541229b-eb03-4266-a63b-9ad0fcedefab None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:13.889747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 556/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:31:13 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:15.790910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a3878-bddf-462e-ba51-c9927b003170 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.791443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a3878-bddf-462e-ba51-c9927b003170 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.791443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a3878-bddf-462e-ba51-c9927b003170 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.792812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 555/1111] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:15.797822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901941-8739-428d-bd82-456c0c117865 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:15.798247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901941-8739-428d-bd82-456c0c117865 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:15.798379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901941-8739-428d-bd82-456c0c117865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:15.816653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f8901941-8739-428d-bd82-456c0c117865 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:15.817844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f8901941-8739-428d-bd82-456c0c117865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:15.861520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:15.882618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 557/1112] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:16.150914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a3878-bddf-462e-ba51-c9927b003170 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.248072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a3878-bddf-462e-ba51-c9927b003170 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.258678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:16.281242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d83d8-d231-4e65-b2c9-2cf38b06bb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.281855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d83d8-d231-4e65-b2c9-2cf38b06bb33 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.282132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d83d8-d231-4e65-b2c9-2cf38b06bb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.282402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d83d8-d231-4e65-b2c9-2cf38b06bb33 None admin] PATH_INFO: `/v3/roles/a37614139c1f4c259c28b64ce0a959a2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.283847 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d83d8-d231-4e65-b2c9-2cf38b06bb33 None admin] RBAC: Authorizing `identity:get_role(role_id=a37614139c1f4c259c28b64ce0a959a2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:16.285223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d83d8-d231-4e65-b2c9-2cf38b06bb33 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:16.286515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 556/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/roles/a37614139c1f4c259c28b64ce0a959a2 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:16.292286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8901941-8739-428d-bd82-456c0c117865 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.388665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8901941-8739-428d-bd82-456c0c117865 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.421179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2d18-461b-4601-891b-d81e008a147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.421805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2d18-461b-4601-891b-d81e008a147e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.422084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2d18-461b-4601-891b-d81e008a147e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.422357 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2d18-461b-4601-891b-d81e008a147e None admin] PATH_INFO: `/v3/users/2ec4301d227744e2960560ffd8b45cd9` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.435391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad2d18-461b-4601-891b-d81e008a147e None admin] RBAC: Authorizing `identity:get_user(user_id=2ec4301d227744e2960560ffd8b45cd9)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:16.436853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad2d18-461b-4601-891b-d81e008a147e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:16.438434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 558/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/users/2ec4301d227744e2960560ffd8b45cd9 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:16.444964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d83d8-d231-4e65-b2c9-2cf38b06bb33 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.542852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d83d8-d231-4e65-b2c9-2cf38b06bb33 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.576502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429189-561a-49d8-ba0a-64d300b2ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.577109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429189-561a-49d8-ba0a-64d300b2ade1 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.577391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429189-561a-49d8-ba0a-64d300b2ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.577665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429189-561a-49d8-ba0a-64d300b2ade1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.622420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:16.644015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71429189-561a-49d8-ba0a-64d300b2ade1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:16.645464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71429189-561a-49d8-ba0a-64d300b2ade1 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:16.740793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 557/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:16.746587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2d18-461b-4601-891b-d81e008a147e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.785450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:16.843413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2d18-461b-4601-891b-d81e008a147e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:16.876518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d6e9a-d880-452d-aa21-df40be1cb439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:16.877144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6e9a-d880-452d-aa21-df40be1cb439 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:16.877425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6e9a-d880-452d-aa21-df40be1cb439 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:16.877698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6e9a-d880-452d-aa21-df40be1cb439 None admin] PATH_INFO: `/v3/projects/2b8f717182a34583b507683068a13dbe` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:16.878798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d6e9a-d880-452d-aa21-df40be1cb439 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f717182a34583b507683068a13dbe)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:16.880268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d6e9a-d880-452d-aa21-df40be1cb439 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:16.881870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 559/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/projects/2b8f717182a34583b507683068a13dbe => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:16.887998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429189-561a-49d8-ba0a-64d300b2ade1 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:16.964556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:16.986855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429189-561a-49d8-ba0a-64d300b2ade1 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:17.020307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2ac99-ea39-455a-9979-affaa76844cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:17.020847 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ac99-ea39-455a-9979-affaa76844cf None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:17.021391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ac99-ea39-455a-9979-affaa76844cf None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:17.021665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ac99-ea39-455a-9979-affaa76844cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:17.022390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2ac99-ea39-455a-9979-affaa76844cf None admin] RBAC: Adding query filter params (role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=2b8f717182a34583b507683068a13dbe, user.id=2ec4301d227744e2960560ffd8b45cd9) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:17.022699 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2ac99-ea39-455a-9979-affaa76844cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:17.024137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2ac99-ea39-455a-9979-affaa76844cf None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:17.029381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 558/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:16 2022] GET /identity/v3/role_assignments?user.id=2ec4301d227744e2960560ffd8b45cd9&scope.project.id=2b8f717182a34583b507683068a13dbe&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:18.893261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f76dd-e8a1-4dc6-aedc-9284eb982c10 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.893815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f76dd-e8a1-4dc6-aedc-9284eb982c10 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.893815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f76dd-e8a1-4dc6-aedc-9284eb982c10 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.895195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 560/1118] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:18.900500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c835e74-eacf-4b53-8f9a-2a777c800809 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:18.900919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c835e74-eacf-4b53-8f9a-2a777c800809 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:18.901054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c835e74-eacf-4b53-8f9a-2a777c800809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:18.919395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-0c835e74-eacf-4b53-8f9a-2a777c800809 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:18.920612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0c835e74-eacf-4b53-8f9a-2a777c800809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:18.985936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 559/1119] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:19.254077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f76dd-e8a1-4dc6-aedc-9284eb982c10 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.352242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f76dd-e8a1-4dc6-aedc-9284eb982c10 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.359575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.385228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1647795-3c3b-4bff-85ee-a617b10fd070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.385844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1647795-3c3b-4bff-85ee-a617b10fd070 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.386123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1647795-3c3b-4bff-85ee-a617b10fd070 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.386398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1647795-3c3b-4bff-85ee-a617b10fd070 None admin] PATH_INFO: `/v3/roles/a37614139c1f4c259c28b64ce0a959a2` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.387790 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1647795-3c3b-4bff-85ee-a617b10fd070 None admin] RBAC: Authorizing `identity:get_role(role_id=a37614139c1f4c259c28b64ce0a959a2)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.389178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1647795-3c3b-4bff-85ee-a617b10fd070 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.390476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 561/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/roles/a37614139c1f4c259c28b64ce0a959a2 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:19.397020 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c835e74-eacf-4b53-8f9a-2a777c800809 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.463767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.494451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c835e74-eacf-4b53-8f9a-2a777c800809 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.528273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb98c8-07b2-4af3-a93b-b3a163dd1a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.528856 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb98c8-07b2-4af3-a93b-b3a163dd1a8a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.529139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb98c8-07b2-4af3-a93b-b3a163dd1a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.529416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb98c8-07b2-4af3-a93b-b3a163dd1a8a None admin] PATH_INFO: `/v3/users/2ec4301d227744e2960560ffd8b45cd9` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.530533 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb98c8-07b2-4af3-a93b-b3a163dd1a8a None admin] RBAC: Authorizing `identity:get_user(user_id=2ec4301d227744e2960560ffd8b45cd9)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.532034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb98c8-07b2-4af3-a93b-b3a163dd1a8a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.533631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 560/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/users/2ec4301d227744e2960560ffd8b45cd9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:19.539462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1647795-3c3b-4bff-85ee-a617b10fd070 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.635043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1647795-3c3b-4bff-85ee-a617b10fd070 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.667343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b51ed-dea9-4049-9b6b-805ef6a33dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.667992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b51ed-dea9-4049-9b6b-805ef6a33dbb None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.668275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b51ed-dea9-4049-9b6b-805ef6a33dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.668552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b51ed-dea9-4049-9b6b-805ef6a33dbb None admin] PATH_INFO: `/v3/projects/2b8f717182a34583b507683068a13dbe` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.669656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b51ed-dea9-4049-9b6b-805ef6a33dbb None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f717182a34583b507683068a13dbe)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.671081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b51ed-dea9-4049-9b6b-805ef6a33dbb None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.672704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 562/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:19 2022] GET /identity/v3/projects/2b8f717182a34583b507683068a13dbe => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:19.678383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb98c8-07b2-4af3-a93b-b3a163dd1a8a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:19.774277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb98c8-07b2-4af3-a93b-b3a163dd1a8a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:19.807560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b00472-cc4a-4d64-a232-f5e6d09cef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:19.808164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00472-cc4a-4d64-a232-f5e6d09cef1c None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:19.808441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00472-cc4a-4d64-a232-f5e6d09cef1c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:19.808711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00472-cc4a-4d64-a232-f5e6d09cef1c None admin] PATH_INFO: `/v3/projects/2b8f717182a34583b507683068a13dbe/users/2ec4301d227744e2960560ffd8b45cd9/roles/a37614139c1f4c259c28b64ce0a959a2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:19.810810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b00472-cc4a-4d64-a232-f5e6d09cef1c None admin] RBAC: Authorizing `identity:create_grant(project_id=2b8f717182a34583b507683068a13dbe, user_id=2ec4301d227744e2960560ffd8b45cd9, role_id=a37614139c1f4c259c28b64ce0a959a2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:19.812254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b00472-cc4a-4d64-a232-f5e6d09cef1c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:19.821630 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:19.827178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 561/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:19 2022] PUT /identity/v3/projects/2b8f717182a34583b507683068a13dbe/users/2ec4301d227744e2960560ffd8b45cd9/roles/a37614139c1f4c259c28b64ce0a959a2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:31:21.683159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820260-2cac-4d2e-8f60-520d66bc71c8 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.683721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820260-2cac-4d2e-8f60-520d66bc71c8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.683721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46820260-2cac-4d2e-8f60-520d66bc71c8 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.685100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 563/1124] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:21.690193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4b6f-4396-448a-a0bf-c41639337f46 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:21.690574 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4b6f-4396-448a-a0bf-c41639337f46 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:21.690740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4b6f-4396-448a-a0bf-c41639337f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:21.709570 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-275b4b6f-4396-448a-a0bf-c41639337f46 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:21.710733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-275b4b6f-4396-448a-a0bf-c41639337f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:21.774231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 562/1125] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:22.037703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46820260-2cac-4d2e-8f60-520d66bc71c8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:22.081124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:22.136914 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46820260-2cac-4d2e-8f60-520d66bc71c8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:22.169279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f471d-6b8e-4972-8c0c-e2a34cc6887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:22.169893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f471d-6b8e-4972-8c0c-e2a34cc6887f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:22.170175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f471d-6b8e-4972-8c0c-e2a34cc6887f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:22.170448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f471d-6b8e-4972-8c0c-e2a34cc6887f None admin] PATH_INFO: `/v3/roles/a37614139c1f4c259c28b64ce0a959a2` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:22.171855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f471d-6b8e-4972-8c0c-e2a34cc6887f None admin] RBAC: Authorizing `identity:get_role(role_id=a37614139c1f4c259c28b64ce0a959a2)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:22.173215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f471d-6b8e-4972-8c0c-e2a34cc6887f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:22.174509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 564/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:22 2022] GET /identity/v3/roles/a37614139c1f4c259c28b64ce0a959a2 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:22.180770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b4b6f-4396-448a-a0bf-c41639337f46 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:22.274521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b4b6f-4396-448a-a0bf-c41639337f46 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:22.301491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:22.307732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bcfa6-7c40-4e6b-8bdc-bedf0875a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:22.308423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bcfa6-7c40-4e6b-8bdc-bedf0875a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:22.308705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bcfa6-7c40-4e6b-8bdc-bedf0875a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:22.308981 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bcfa6-7c40-4e6b-8bdc-bedf0875a8f0 None admin] PATH_INFO: `/v3/users/2ec4301d227744e2960560ffd8b45cd9` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:22.310114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bcfa6-7c40-4e6b-8bdc-bedf0875a8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=2ec4301d227744e2960560ffd8b45cd9)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:22.311543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bcfa6-7c40-4e6b-8bdc-bedf0875a8f0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:22.313146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 563/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:22 2022] GET /identity/v3/users/2ec4301d227744e2960560ffd8b45cd9 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:22.319291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f471d-6b8e-4972-8c0c-e2a34cc6887f None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:22.414243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f471d-6b8e-4972-8c0c-e2a34cc6887f None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:22.423997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:22.447192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72296b67-0d8e-4900-a11d-afa46959673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:22.447812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296b67-0d8e-4900-a11d-afa46959673b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:22.448098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296b67-0d8e-4900-a11d-afa46959673b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:22.448372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72296b67-0d8e-4900-a11d-afa46959673b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:22.514248 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72296b67-0d8e-4900-a11d-afa46959673b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:22.515698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72296b67-0d8e-4900-a11d-afa46959673b None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:22.614434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 565/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:22.622881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bcfa6-7c40-4e6b-8bdc-bedf0875a8f0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:22.721217 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bcfa6-7c40-4e6b-8bdc-bedf0875a8f0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:22.754628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61309ce-e0cb-4998-ab82-2b7b730e9fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:22.755252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61309ce-e0cb-4998-ab82-2b7b730e9fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:22.755536 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61309ce-e0cb-4998-ab82-2b7b730e9fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:22.755840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61309ce-e0cb-4998-ab82-2b7b730e9fd4 None admin] PATH_INFO: `/v3/projects/2b8f717182a34583b507683068a13dbe` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:22.756966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61309ce-e0cb-4998-ab82-2b7b730e9fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=2b8f717182a34583b507683068a13dbe)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:22.758393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61309ce-e0cb-4998-ab82-2b7b730e9fd4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:22.760044 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 564/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:22 2022] GET /identity/v3/projects/2b8f717182a34583b507683068a13dbe => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:22.766057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72296b67-0d8e-4900-a11d-afa46959673b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:22.777550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:22.861961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72296b67-0d8e-4900-a11d-afa46959673b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:22.893707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b87914-d42c-482a-aa46-42fceb5ff0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:22.894747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87914-d42c-482a-aa46-42fceb5ff0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:22.895026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87914-d42c-482a-aa46-42fceb5ff0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:22.895299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87914-d42c-482a-aa46-42fceb5ff0b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:22.896308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b87914-d42c-482a-aa46-42fceb5ff0b4 None admin] RBAC: Adding query filter params (role.id=a37614139c1f4c259c28b64ce0a959a2, scope.project.id=2b8f717182a34583b507683068a13dbe, user.id=2ec4301d227744e2960560ffd8b45cd9) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:22.896618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b87914-d42c-482a-aa46-42fceb5ff0b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:22.898038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b87914-d42c-482a-aa46-42fceb5ff0b4 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:22.903516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 566/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:22 2022] GET /identity/v3/role_assignments?user.id=2ec4301d227744e2960560ffd8b45cd9&scope.project.id=2b8f717182a34583b507683068a13dbe&role.id=a37614139c1f4c259c28b64ce0a959a2 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:24.807341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1c90-4b0c-4c0c-83f6-724b9e5a633e None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.808033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1c90-4b0c-4c0c-83f6-724b9e5a633e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.808033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c1c90-4b0c-4c0c-83f6-724b9e5a633e None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.809248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 565/1131] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:24.814406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ea17-dcd4-43bd-8828-6545db082bf2 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:24.814832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ea17-dcd4-43bd-8828-6545db082bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:24.814944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ea17-dcd4-43bd-8828-6545db082bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:24.834089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-1633ea17-dcd4-43bd-8828-6545db082bf2 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:24.835266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1633ea17-dcd4-43bd-8828-6545db082bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:24.899767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 567/1132] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:25.170139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c1c90-4b0c-4c0c-83f6-724b9e5a633e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.234661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:25.269610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c1c90-4b0c-4c0c-83f6-724b9e5a633e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.302503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034228d-8ce7-4819-9061-00a20dc63b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.303110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034228d-8ce7-4819-9061-00a20dc63b93 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.303434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034228d-8ce7-4819-9061-00a20dc63b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.303657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034228d-8ce7-4819-9061-00a20dc63b93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.304781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034228d-8ce7-4819-9061-00a20dc63b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.306193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034228d-8ce7-4819-9061-00a20dc63b93 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.307721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 566/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:25.313570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633ea17-dcd4-43bd-8828-6545db082bf2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:25.317183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:25.408251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633ea17-dcd4-43bd-8828-6545db082bf2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:25.440586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c655596-d810-4a34-9961-a805ef73ae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:25.441715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c655596-d810-4a34-9961-a805ef73ae75 None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:25.441992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c655596-d810-4a34-9961-a805ef73ae75 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:25.442259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c655596-d810-4a34-9961-a805ef73ae75 None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:25.442893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c655596-d810-4a34-9961-a805ef73ae75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:25.444346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c655596-d810-4a34-9961-a805ef73ae75 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:25.469680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 568/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:25 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:27.403932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866f46c-f049-4065-abb4-9b6361dbf6f6 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.404455 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866f46c-f049-4065-abb4-9b6361dbf6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.404455 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866f46c-f049-4065-abb4-9b6361dbf6f6 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.405755 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 567/1135] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:27.411550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159fadf-1162-4f22-b5c6-45bceb52f4b4 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.411963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159fadf-1162-4f22-b5c6-45bceb52f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.412147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159fadf-1162-4f22-b5c6-45bceb52f4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.429921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3159fadf-1162-4f22-b5c6-45bceb52f4b4 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:27.431097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3159fadf-1162-4f22-b5c6-45bceb52f4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:27.479740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:27.496909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 569/1136] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:27.764770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866f46c-f049-4065-abb4-9b6361dbf6f6 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:27.863497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866f46c-f049-4065-abb4-9b6361dbf6f6 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:27.897050 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688039f5-1fba-44bc-8895-aa666afb7e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:27.897663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688039f5-1fba-44bc-8895-aa666afb7e76 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:27.897945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688039f5-1fba-44bc-8895-aa666afb7e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:27.898219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688039f5-1fba-44bc-8895-aa666afb7e76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:27.899335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688039f5-1fba-44bc-8895-aa666afb7e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:27.900788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688039f5-1fba-44bc-8895-aa666afb7e76 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:27.902327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 568/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:31:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:27.907946 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159fadf-1162-4f22-b5c6-45bceb52f4b4 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:28.002195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159fadf-1162-4f22-b5c6-45bceb52f4b4 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:28.035332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e815c-e5d9-4a18-aacf-c5414a88c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:28.035901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e815c-e5d9-4a18-aacf-c5414a88c2fb None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:28.036185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e815c-e5d9-4a18-aacf-c5414a88c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:28.036457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e815c-e5d9-4a18-aacf-c5414a88c2fb None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:28.037094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e815c-e5d9-4a18-aacf-c5414a88c2fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:28.038521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e815c-e5d9-4a18-aacf-c5414a88c2fb None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:28.058985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 570/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:31:27 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:30.001094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e903a-6ec8-45ad-8603-412b37bba9ae None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.001594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e903a-6ec8-45ad-8603-412b37bba9ae None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.001686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e903a-6ec8-45ad-8603-412b37bba9ae None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.002983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 569/1139] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:30.008195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebc397-aa78-4db7-876d-67f7731080f2 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.008570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebc397-aa78-4db7-876d-67f7731080f2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.008754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebc397-aa78-4db7-876d-67f7731080f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.026659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ccebc397-aa78-4db7-876d-67f7731080f2 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:30.027858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ccebc397-aa78-4db7-876d-67f7731080f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:30.062699 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.094131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 571/1140] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:30.357339 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e903a-6ec8-45ad-8603-412b37bba9ae None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.360184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.455169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e903a-6ec8-45ad-8603-412b37bba9ae None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.488780 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65bc3-3029-4f93-8a02-d846f16d8a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.489391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65bc3-3029-4f93-8a02-d846f16d8a6b None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.489666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65bc3-3029-4f93-8a02-d846f16d8a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.489936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65bc3-3029-4f93-8a02-d846f16d8a6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.499628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c65bc3-3029-4f93-8a02-d846f16d8a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-70c65bc3-3029-4f93-8a02-d846f16d8a6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:30.504421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:30.505462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:30.506375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 570/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:30.511310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebc397-aa78-4db7-876d-67f7731080f2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.605605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebc397-aa78-4db7-876d-67f7731080f2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.637847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.638388 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.638667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.638941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.639596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:30.639928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.641301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.650031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 572/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:30.655674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65bc3-3029-4f93-8a02-d846f16d8a6b None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.715955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.752963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65bc3-3029-4f93-8a02-d846f16d8a6b None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.785965 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e04673-a869-4d36-8e5d-6ee87a0b2806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.786588 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04673-a869-4d36-8e5d-6ee87a0b2806 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.786868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04673-a869-4d36-8e5d-6ee87a0b2806 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.787143 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04673-a869-4d36-8e5d-6ee87a0b2806 None admin] PATH_INFO: `/v3/users/a0b026509a7e4339b4d483bb00d22de5` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:30.799637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e04673-a869-4d36-8e5d-6ee87a0b2806 None admin] RBAC: Authorizing `identity:get_user(user_id=a0b026509a7e4339b4d483bb00d22de5)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:30.801101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e04673-a869-4d36-8e5d-6ee87a0b2806 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:30.802683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 571/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/users/a0b026509a7e4339b4d483bb00d22de5 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:30.808517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:30.842378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:30.906912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba54c-18cf-4273-963e-b3fcee90a069 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:30.938503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bfaf0-8f09-42fe-9a30-3926a5e41bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:30.939098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bfaf0-8f09-42fe-9a30-3926a5e41bec None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:30.939377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bfaf0-8f09-42fe-9a30-3926a5e41bec None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:30.939650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bfaf0-8f09-42fe-9a30-3926a5e41bec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.005139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bfaf0-8f09-42fe-9a30-3926a5e41bec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.006589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bfaf0-8f09-42fe-9a30-3926a5e41bec None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.038050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.101096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 573/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:31.106998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e04673-a869-4d36-8e5d-6ee87a0b2806 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:31.202884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e04673-a869-4d36-8e5d-6ee87a0b2806 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.221818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.235383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7842a-c0bd-4161-9917-c05cc9ead617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.236029 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7842a-c0bd-4161-9917-c05cc9ead617 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.236311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7842a-c0bd-4161-9917-c05cc9ead617 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.236582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7842a-c0bd-4161-9917-c05cc9ead617 None admin] PATH_INFO: `/v3/projects/17def586139d40259079270bbcf949f5` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.237699 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7842a-c0bd-4161-9917-c05cc9ead617 None admin] RBAC: Authorizing `identity:get_project(project_id=17def586139d40259079270bbcf949f5)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.239612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7842a-c0bd-4161-9917-c05cc9ead617 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.241257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 572/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:31 2022] GET /identity/v3/projects/17def586139d40259079270bbcf949f5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:31.247106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bfaf0-8f09-42fe-9a30-3926a5e41bec None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:31.340763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bfaf0-8f09-42fe-9a30-3926a5e41bec None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:31.372890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4d614-b527-40c5-9a85-172f3c941586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:31.373478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4d614-b527-40c5-9a85-172f3c941586 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:31.373758 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4d614-b527-40c5-9a85-172f3c941586 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:31.374033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4d614-b527-40c5-9a85-172f3c941586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:31.374748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4d614-b527-40c5-9a85-172f3c941586 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=17def586139d40259079270bbcf949f5, user.id=a0b026509a7e4339b4d483bb00d22de5) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:31.375057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4d614-b527-40c5-9a85-172f3c941586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:31.376504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4d614-b527-40c5-9a85-172f3c941586 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:31.378197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:31.383361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 574/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:31 2022] GET /identity/v3/role_assignments?user.id=a0b026509a7e4339b4d483bb00d22de5&scope.project.id=17def586139d40259079270bbcf949f5&role.id=32319452053845419798d329f1c194d4 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:33.241141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737da2-f631-4505-bfda-8eb41564b46e None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.241651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737da2-f631-4505-bfda-8eb41564b46e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.241651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5737da2-f631-4505-bfda-8eb41564b46e None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.242954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 573/1147] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:33.248158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823873-b522-4b87-a3a9-a80e8883dfd1 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.248556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823873-b522-4b87-a3a9-a80e8883dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.248716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f823873-b522-4b87-a3a9-a80e8883dfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.266285 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6f823873-b522-4b87-a3a9-a80e8883dfd1 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:33.267456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6f823873-b522-4b87-a3a9-a80e8883dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:33.331378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 575/1148] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:33.600066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5737da2-f631-4505-bfda-8eb41564b46e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:33.698236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5737da2-f631-4505-bfda-8eb41564b46e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:33.730945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901aa2d-f8d9-4145-882b-c07d34454f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:33.731557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901aa2d-f8d9-4145-882b-c07d34454f9c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.731860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901aa2d-f8d9-4145-882b-c07d34454f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.732133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901aa2d-f8d9-4145-882b-c07d34454f9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.741928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901aa2d-f8d9-4145-882b-c07d34454f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-4901aa2d-f8d9-4145-882b-c07d34454f9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:33.746690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:33.747803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:33.748652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 574/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:33.753532 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f823873-b522-4b87-a3a9-a80e8883dfd1 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:33.849416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f823873-b522-4b87-a3a9-a80e8883dfd1 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:33.874502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:33.882735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:33.883339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:33.883620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:33.883926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:33.884587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:33.884891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:33.886260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:33.893992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 576/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:33.900607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901aa2d-f8d9-4145-882b-c07d34454f9c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:33.948465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:33.997867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901aa2d-f8d9-4145-882b-c07d34454f9c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.031214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929ecfb-d04b-44bc-9294-29e9dc2d6da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.031857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929ecfb-d04b-44bc-9294-29e9dc2d6da8 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.032141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929ecfb-d04b-44bc-9294-29e9dc2d6da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.032417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929ecfb-d04b-44bc-9294-29e9dc2d6da8 None admin] PATH_INFO: `/v3/users/a0b026509a7e4339b4d483bb00d22de5` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.033537 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929ecfb-d04b-44bc-9294-29e9dc2d6da8 None admin] RBAC: Authorizing `identity:get_user(user_id=a0b026509a7e4339b4d483bb00d22de5)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.034998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929ecfb-d04b-44bc-9294-29e9dc2d6da8 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.036597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 575/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:33 2022] GET /identity/v3/users/a0b026509a7e4339b4d483bb00d22de5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:34.042482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.139608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d437d-2aa5-4257-a82d-c38c35e2b364 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.171700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1d681-2d8f-44ee-8b68-14c6b2c0309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.172410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1d681-2d8f-44ee-8b68-14c6b2c0309f None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.172692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1d681-2d8f-44ee-8b68-14c6b2c0309f None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.172966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1d681-2d8f-44ee-8b68-14c6b2c0309f None admin] PATH_INFO: `/v3/projects/17def586139d40259079270bbcf949f5` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.174072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1d681-2d8f-44ee-8b68-14c6b2c0309f None admin] RBAC: Authorizing `identity:get_project(project_id=17def586139d40259079270bbcf949f5)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.176028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1d681-2d8f-44ee-8b68-14c6b2c0309f None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.177621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 577/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:34 2022] GET /identity/v3/projects/17def586139d40259079270bbcf949f5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:34.183253 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929ecfb-d04b-44bc-9294-29e9dc2d6da8 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:34.279150 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929ecfb-d04b-44bc-9294-29e9dc2d6da8 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:34.295332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:34.313420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d771793-ba9b-40a7-830f-a2fa836b04c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:34.314062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d771793-ba9b-40a7-830f-a2fa836b04c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:34.314340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d771793-ba9b-40a7-830f-a2fa836b04c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:34.314612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d771793-ba9b-40a7-830f-a2fa836b04c7 None admin] PATH_INFO: `/v3/projects/17def586139d40259079270bbcf949f5/users/a0b026509a7e4339b4d483bb00d22de5/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:34.317038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d771793-ba9b-40a7-830f-a2fa836b04c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=17def586139d40259079270bbcf949f5, user_id=a0b026509a7e4339b4d483bb00d22de5, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:34.318462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d771793-ba9b-40a7-830f-a2fa836b04c7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:34.331152 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 576/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:34 2022] PUT /identity/v3/projects/17def586139d40259079270bbcf949f5/users/a0b026509a7e4339b4d483bb00d22de5/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:31:36.170956 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f15d-adea-4d79-9003-bac61529d2e8 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:36.171505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f15d-adea-4d79-9003-bac61529d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:36.171505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f15d-adea-4d79-9003-bac61529d2e8 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:36.172884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 578/1154] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:36.178689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c204d-0413-4394-b83f-83e09a446f6d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:36.179083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c204d-0413-4394-b83f-83e09a446f6d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:36.179245 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c204d-0413-4394-b83f-83e09a446f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:36.196994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-297c204d-0413-4394-b83f-83e09a446f6d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:36.198201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-297c204d-0413-4394-b83f-83e09a446f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:36.262578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 577/1155] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:36.529075 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921f15d-adea-4d79-9003-bac61529d2e8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:36.587095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:36.628625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921f15d-adea-4d79-9003-bac61529d2e8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:36.662698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27873fd1-7aed-4f93-8af7-2449dc6fbde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:36.663320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27873fd1-7aed-4f93-8af7-2449dc6fbde2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:36.663604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27873fd1-7aed-4f93-8af7-2449dc6fbde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:36.663906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27873fd1-7aed-4f93-8af7-2449dc6fbde2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:36.673746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27873fd1-7aed-4f93-8af7-2449dc6fbde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-27873fd1-7aed-4f93-8af7-2449dc6fbde2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:36.678517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:36.679596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:36.680650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 579/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:36.685572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c204d-0413-4394-b83f-83e09a446f6d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:36.781905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c204d-0413-4394-b83f-83e09a446f6d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:36.788778 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:36.815129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:36.815728 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:36.816560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:36.816833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:36.817490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:36.817791 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:36.819145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:36.826860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 578/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:36.833208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27873fd1-7aed-4f93-8af7-2449dc6fbde2 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:36.928905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27873fd1-7aed-4f93-8af7-2449dc6fbde2 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:36.945639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:36.963138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ef2a0-29cc-4d2d-b41f-d4abb941c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:36.963761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef2a0-29cc-4d2d-b41f-d4abb941c5df None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:36.964065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef2a0-29cc-4d2d-b41f-d4abb941c5df None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:36.964338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef2a0-29cc-4d2d-b41f-d4abb941c5df None admin] PATH_INFO: `/v3/users/a0b026509a7e4339b4d483bb00d22de5` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:36.965479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef2a0-29cc-4d2d-b41f-d4abb941c5df None admin] RBAC: Authorizing `identity:get_user(user_id=a0b026509a7e4339b4d483bb00d22de5)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:36.966911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef2a0-29cc-4d2d-b41f-d4abb941c5df None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:36.968525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 580/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:36 2022] GET /identity/v3/users/a0b026509a7e4339b4d483bb00d22de5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:36.974291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.070886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677aea4-c086-4707-b1b9-a0038a45ee06 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:37.102410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b6fa7-da25-4b1e-b41a-f6ae837d388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:37.103000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b6fa7-da25-4b1e-b41a-f6ae837d388d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.103282 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b6fa7-da25-4b1e-b41a-f6ae837d388d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.103559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b6fa7-da25-4b1e-b41a-f6ae837d388d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.137025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:37.169145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b6fa7-da25-4b1e-b41a-f6ae837d388d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:37.170588 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b6fa7-da25-4b1e-b41a-f6ae837d388d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:37.265572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 579/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:37.271892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ef2a0-29cc-4d2d-b41f-d4abb941c5df None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.366067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ef2a0-29cc-4d2d-b41f-d4abb941c5df None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:37.397894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae3c99-32c7-41f7-a84b-49810b4e0947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:37.398504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3c99-32c7-41f7-a84b-49810b4e0947 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.398781 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3c99-32c7-41f7-a84b-49810b4e0947 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.399050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3c99-32c7-41f7-a84b-49810b4e0947 None admin] PATH_INFO: `/v3/projects/17def586139d40259079270bbcf949f5` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.400165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae3c99-32c7-41f7-a84b-49810b4e0947 None admin] RBAC: Authorizing `identity:get_project(project_id=17def586139d40259079270bbcf949f5)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:37.401587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae3c99-32c7-41f7-a84b-49810b4e0947 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:37.403162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 581/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/projects/17def586139d40259079270bbcf949f5 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:37.409260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b6fa7-da25-4b1e-b41a-f6ae837d388d None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:37.473804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:37.506555 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b6fa7-da25-4b1e-b41a-f6ae837d388d None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:37.539927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c33477-6c51-4035-9ea6-5bb74bdf6db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:37.540524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33477-6c51-4035-9ea6-5bb74bdf6db7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:37.540808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33477-6c51-4035-9ea6-5bb74bdf6db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:37.541085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33477-6c51-4035-9ea6-5bb74bdf6db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:37.541815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c33477-6c51-4035-9ea6-5bb74bdf6db7 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=17def586139d40259079270bbcf949f5, user.id=a0b026509a7e4339b4d483bb00d22de5) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:37.542126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c33477-6c51-4035-9ea6-5bb74bdf6db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:37.543546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c33477-6c51-4035-9ea6-5bb74bdf6db7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:37.549203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 580/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:37 2022] GET /identity/v3/role_assignments?user.id=a0b026509a7e4339b4d483bb00d22de5&scope.project.id=17def586139d40259079270bbcf949f5&role.id=32319452053845419798d329f1c194d4 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:39.437812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41d489-0670-4a83-a31d-0a7fc87360d9 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:39.438366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41d489-0670-4a83-a31d-0a7fc87360d9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:39.438366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41d489-0670-4a83-a31d-0a7fc87360d9 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:39.439711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 582/1162] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:39.445334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce537c-071a-421a-9e18-2f282b77ef18 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:39.445744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce537c-071a-421a-9e18-2f282b77ef18 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:39.445919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce537c-071a-421a-9e18-2f282b77ef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:39.464419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-30ce537c-071a-421a-9e18-2f282b77ef18 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:39.465606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-30ce537c-071a-421a-9e18-2f282b77ef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:39.529600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 581/1163] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:39.796081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41d489-0670-4a83-a31d-0a7fc87360d9 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:39.851935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:39.896427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41d489-0670-4a83-a31d-0a7fc87360d9 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:39.928052 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3a41-050d-402b-8389-378ccfb01b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:39.928650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3a41-050d-402b-8389-378ccfb01b3c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:39.928932 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3a41-050d-402b-8389-378ccfb01b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:39.929204 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3a41-050d-402b-8389-378ccfb01b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:39.993805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3a41-050d-402b-8389-378ccfb01b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:39.995245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3a41-050d-402b-8389-378ccfb01b3c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:40.046642 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:40.090238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 583/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:40.096168 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce537c-071a-421a-9e18-2f282b77ef18 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:40.155704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:40.193465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce537c-071a-421a-9e18-2f282b77ef18 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:40.225672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e256b7-e031-4592-b5c4-0104fd5671f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:40.226290 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e256b7-e031-4592-b5c4-0104fd5671f6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.226573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e256b7-e031-4592-b5c4-0104fd5671f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.226847 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e256b7-e031-4592-b5c4-0104fd5671f6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.233306 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e256b7-e031-4592-b5c4-0104fd5671f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:40.234742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e256b7-e031-4592-b5c4-0104fd5671f6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-30e256b7-e031-4592-b5c4-0104fd5671f6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:40.246410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:40.247684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:40.248884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 582/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:31:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:40.253861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3a41-050d-402b-8389-378ccfb01b3c None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:40.347500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3a41-050d-402b-8389-378ccfb01b3c None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:40.380166 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd566-b7b0-41c6-947d-6bf1ae120184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:40.380759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd566-b7b0-41c6-947d-6bf1ae120184 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:40.381037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd566-b7b0-41c6-947d-6bf1ae120184 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:40.381308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd566-b7b0-41c6-947d-6bf1ae120184 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:40.381940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cd566-b7b0-41c6-947d-6bf1ae120184 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:40.382244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cd566-b7b0-41c6-947d-6bf1ae120184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:40.383602 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cd566-b7b0-41c6-947d-6bf1ae120184 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:40.390445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 584/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Thu Sep 1 15:31:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:42.263957 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a082-1c46-4c38-bf9e-dfe42f64696e None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:42.264451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a082-1c46-4c38-bf9e-dfe42f64696e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:42.264451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9a082-1c46-4c38-bf9e-dfe42f64696e None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:42.265785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 583/1167] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:42.271233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bc71f-8c13-458e-a356-e622d8a53055 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:42.271661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bc71f-8c13-458e-a356-e622d8a53055 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:42.271798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bc71f-8c13-458e-a356-e622d8a53055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:42.289890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-888bc71f-8c13-458e-a356-e622d8a53055 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:42.291064 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-888bc71f-8c13-458e-a356-e622d8a53055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:42.304421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:42.355892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 585/1168] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:42.620760 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a082-1c46-4c38-bf9e-dfe42f64696e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:42.726239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9a082-1c46-4c38-bf9e-dfe42f64696e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:42.752785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:42.764660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87245a-9da1-4083-83a2-0a4966d7709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:42.765263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87245a-9da1-4083-83a2-0a4966d7709b None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:42.765546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87245a-9da1-4083-83a2-0a4966d7709b None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:42.765845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87245a-9da1-4083-83a2-0a4966d7709b None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:42.766522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87245a-9da1-4083-83a2-0a4966d7709b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:42.768054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87245a-9da1-4083-83a2-0a4966d7709b None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:42.783127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 584/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Thu Sep 1 15:31:42 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:44.681827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bbda-f06d-416e-a5d1-48e9436756f1 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.682381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bbda-f06d-416e-a5d1-48e9436756f1 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.682381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bbda-f06d-416e-a5d1-48e9436756f1 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.683715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 586/1170] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:44.689082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd55fc-fdd0-4323-9085-347696cd9d63 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:44.689500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd55fc-fdd0-4323-9085-347696cd9d63 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:44.689645 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd55fc-fdd0-4323-9085-347696cd9d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:44.708421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3ebd55fc-fdd0-4323-9085-347696cd9d63 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:44.709607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3ebd55fc-fdd0-4323-9085-347696cd9d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:44.775385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 585/1171] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:45.039443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3bbda-f06d-416e-a5d1-48e9436756f1 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:45.137330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3bbda-f06d-416e-a5d1-48e9436756f1 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:45.169937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f53ca-632f-4a17-86d5-fe0ee5f9fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:45.170551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f53ca-632f-4a17-86d5-fe0ee5f9fc37 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.170828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f53ca-632f-4a17-86d5-fe0ee5f9fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.171100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f53ca-632f-4a17-86d5-fe0ee5f9fc37 None admin] PATH_INFO: `/v3/domains/03fcb2a65e7d4ebaa6707f28b8f4c094` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.181051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f53ca-632f-4a17-86d5-fe0ee5f9fc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=03fcb2a65e7d4ebaa6707f28b8f4c094)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:45.182495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f53ca-632f-4a17-86d5-fe0ee5f9fc37 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:45.184072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 587/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Thu Sep 1 15:31:45 2022] GET /identity/v3/domains/03fcb2a65e7d4ebaa6707f28b8f4c094 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:45.189772 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd55fc-fdd0-4323-9085-347696cd9d63 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:45.285752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd55fc-fdd0-4323-9085-347696cd9d63 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:45.298238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:45.321440 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eafb2c-7731-4e9a-9cab-bc2661998517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:45.322053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eafb2c-7731-4e9a-9cab-bc2661998517 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:45.322337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eafb2c-7731-4e9a-9cab-bc2661998517 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:45.322611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eafb2c-7731-4e9a-9cab-bc2661998517 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:45.323268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eafb2c-7731-4e9a-9cab-bc2661998517 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:45.324738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eafb2c-7731-4e9a-9cab-bc2661998517 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:45.349573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 586/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:31:45 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:47.312573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e981-ec22-4ed7-98b0-423363e2d6b7 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.313074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e981-ec22-4ed7-98b0-423363e2d6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.313074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8e981-ec22-4ed7-98b0-423363e2d6b7 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.314370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 588/1174] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:47.319472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b376be-5de7-4b5c-b4be-2b89e9464f84 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.319874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b376be-5de7-4b5c-b4be-2b89e9464f84 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.320065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b376be-5de7-4b5c-b4be-2b89e9464f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.337883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-11b376be-5de7-4b5c-b4be-2b89e9464f84 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:47.339058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-11b376be-5de7-4b5c-b4be-2b89e9464f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:47.405401 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 587/1175] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:47.676659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e981-ec22-4ed7-98b0-423363e2d6b7 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:47.688477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:47.776763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8e981-ec22-4ed7-98b0-423363e2d6b7 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:47.809245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a2eee-4a34-46b8-952d-b736786b97bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:47.809865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a2eee-4a34-46b8-952d-b736786b97bc None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.810145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a2eee-4a34-46b8-952d-b736786b97bc None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.810419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a2eee-4a34-46b8-952d-b736786b97bc None admin] PATH_INFO: `/v3/domains/03fcb2a65e7d4ebaa6707f28b8f4c094` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.811528 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a2eee-4a34-46b8-952d-b736786b97bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=03fcb2a65e7d4ebaa6707f28b8f4c094)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:47.813000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a2eee-4a34-46b8-952d-b736786b97bc None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:47.814548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 589/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Thu Sep 1 15:31:47 2022] GET /identity/v3/domains/03fcb2a65e7d4ebaa6707f28b8f4c094 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:47.820161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b376be-5de7-4b5c-b4be-2b89e9464f84 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:47.909713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:47.917210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b376be-5de7-4b5c-b4be-2b89e9464f84 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:47.951477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee46827-dce5-4059-bc8f-4687dcf0d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:47.952065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46827-dce5-4059-bc8f-4687dcf0d22d None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:47.952351 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46827-dce5-4059-bc8f-4687dcf0d22d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:47.952628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee46827-dce5-4059-bc8f-4687dcf0d22d None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:47.953295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee46827-dce5-4059-bc8f-4687dcf0d22d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:47.954728 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee46827-dce5-4059-bc8f-4687dcf0d22d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:47.975945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 588/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:31:47 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:31:49.913220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3c29-e4f9-443e-a5fa-d7243b405c1b None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.913751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3c29-e4f9-443e-a5fa-d7243b405c1b None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.913751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3c29-e4f9-443e-a5fa-d7243b405c1b None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.915071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 590/1178] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:49.920404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d3c7-5929-408c-b4f4-0f5afe08548d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:49.920781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d3c7-5929-408c-b4f4-0f5afe08548d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:49.920963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d3c7-5929-408c-b4f4-0f5afe08548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:49.939216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-b8c9d3c7-5929-408c-b4f4-0f5afe08548d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:49.941031 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b8c9d3c7-5929-408c-b4f4-0f5afe08548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:50.005874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 589/1179] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:50.272588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3c29-e4f9-443e-a5fa-d7243b405c1b None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.348108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.372103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3c29-e4f9-443e-a5fa-d7243b405c1b None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.406427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941bb53-80d7-443c-a677-c292a54882ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.407038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941bb53-80d7-443c-a677-c292a54882ea None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.407315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941bb53-80d7-443c-a677-c292a54882ea None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.407583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941bb53-80d7-443c-a677-c292a54882ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.417816 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941bb53-80d7-443c-a677-c292a54882ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b941bb53-80d7-443c-a677-c292a54882ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:50.422486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:50.423665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:50.425482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 591/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:50.430166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d3c7-5929-408c-b4f4-0f5afe08548d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.507075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.526894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d3c7-5929-408c-b4f4-0f5afe08548d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.560103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.560705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.560987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.561260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.561922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:50.562226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.563587 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.571373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 590/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:50.576975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941bb53-80d7-443c-a677-c292a54882ea None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.672874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941bb53-80d7-443c-a677-c292a54882ea None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.704824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0db20-01fa-4a8f-8116-bba9eaea6d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.705441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0db20-01fa-4a8f-8116-bba9eaea6d92 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.705716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0db20-01fa-4a8f-8116-bba9eaea6d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.706511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0db20-01fa-4a8f-8116-bba9eaea6d92 None admin] PATH_INFO: `/v3/users/41b6c576ef7040378b6a04b6a042fb93` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.709180 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.720917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0db20-01fa-4a8f-8116-bba9eaea6d92 None admin] RBAC: Authorizing `identity:get_user(user_id=41b6c576ef7040378b6a04b6a042fb93)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.722955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0db20-01fa-4a8f-8116-bba9eaea6d92 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:50.724625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 592/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/users/41b6c576ef7040378b6a04b6a042fb93 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:50.730471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:50.832950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707daf43-d8ff-4de2-922f-c8aae89d4ab7 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:50.865233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe4f82-7e9d-40ad-b6f2-c6870f8d4ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:50.865834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4f82-7e9d-40ad-b6f2-c6870f8d4ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:50.866115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4f82-7e9d-40ad-b6f2-c6870f8d4ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:50.866391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4f82-7e9d-40ad-b6f2-c6870f8d4ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:50.877685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:50.931779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe4f82-7e9d-40ad-b6f2-c6870f8d4ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:50.933237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe4f82-7e9d-40ad-b6f2-c6870f8d4ed0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:51.030645 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 591/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:51.036660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0db20-01fa-4a8f-8116-bba9eaea6d92 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:51.130996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0db20-01fa-4a8f-8116-bba9eaea6d92 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:51.163611 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448ffa4-ec50-4dc0-9e08-b2ad797a3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:51.164246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ffa4-ec50-4dc0-9e08-b2ad797a3102 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:51.164565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ffa4-ec50-4dc0-9e08-b2ad797a3102 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:51.164796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ffa4-ec50-4dc0-9e08-b2ad797a3102 None admin] PATH_INFO: `/v3/projects/130a86f331cd467b8f5f811d4adaa271` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:51.165892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448ffa4-ec50-4dc0-9e08-b2ad797a3102 None admin] RBAC: Authorizing `identity:get_project(project_id=130a86f331cd467b8f5f811d4adaa271)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:51.167315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448ffa4-ec50-4dc0-9e08-b2ad797a3102 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:51.168921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 593/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:51 2022] GET /identity/v3/projects/130a86f331cd467b8f5f811d4adaa271 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:51.174773 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe4f82-7e9d-40ad-b6f2-c6870f8d4ed0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:51.217156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:51.271716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe4f82-7e9d-40ad-b6f2-c6870f8d4ed0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:51.303752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b82763-e0ff-4148-9423-d12c179dc642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:51.304512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82763-e0ff-4148-9423-d12c179dc642 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:51.304785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82763-e0ff-4148-9423-d12c179dc642 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:51.305053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82763-e0ff-4148-9423-d12c179dc642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:51.305768 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82763-e0ff-4148-9423-d12c179dc642 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=130a86f331cd467b8f5f811d4adaa271, user.id=41b6c576ef7040378b6a04b6a042fb93) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:51.306074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82763-e0ff-4148-9423-d12c179dc642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:51.307485 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82763-e0ff-4148-9423-d12c179dc642 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:51.312625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 592/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:51 2022] GET /identity/v3/role_assignments?user.id=41b6c576ef7040378b6a04b6a042fb93&scope.project.id=130a86f331cd467b8f5f811d4adaa271&role.id=32319452053845419798d329f1c194d4 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:53.170385 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1cc9-f8b4-49e3-af79-3d4b73733f5f None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.170923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1cc9-f8b4-49e3-af79-3d4b73733f5f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.170923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1cc9-f8b4-49e3-af79-3d4b73733f5f None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.172311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 594/1186] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:53.177497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962110-c031-4865-a070-32bcff4642cb None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.177910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962110-c031-4865-a070-32bcff4642cb None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.178051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c962110-c031-4865-a070-32bcff4642cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.196291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-0c962110-c031-4865-a070-32bcff4642cb None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:53.197474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0c962110-c031-4865-a070-32bcff4642cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:53.261589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 593/1187] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:53.527573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a1cc9-f8b4-49e3-af79-3d4b73733f5f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.587857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.625696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a1cc9-f8b4-49e3-af79-3d4b73733f5f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.658971 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da17174-4302-4b62-b835-3f123e241c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.659590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da17174-4302-4b62-b835-3f123e241c0a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.659897 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da17174-4302-4b62-b835-3f123e241c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.660173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da17174-4302-4b62-b835-3f123e241c0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.669903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da17174-4302-4b62-b835-3f123e241c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-7da17174-4302-4b62-b835-3f123e241c0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:53.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:53.677014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:31:53.678688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 595/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:53.682221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c962110-c031-4865-a070-32bcff4642cb None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.715934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.778961 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c962110-c031-4865-a070-32bcff4642cb None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.811604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.812232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.812517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.812793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.813455 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:53.813763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.815662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.823421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 594/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:31:53.829203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da17174-4302-4b62-b835-3f123e241c0a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:53.925985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da17174-4302-4b62-b835-3f123e241c0a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:53.947121 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:53.959191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770a06-61b5-4a9a-b5ea-40b64b831973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:53.959850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770a06-61b5-4a9a-b5ea-40b64b831973 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:53.960131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770a06-61b5-4a9a-b5ea-40b64b831973 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:53.960401 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02770a06-61b5-4a9a-b5ea-40b64b831973 None admin] PATH_INFO: `/v3/users/41b6c576ef7040378b6a04b6a042fb93` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:53.961509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02770a06-61b5-4a9a-b5ea-40b64b831973 None admin] RBAC: Authorizing `identity:get_user(user_id=41b6c576ef7040378b6a04b6a042fb93)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:53.962939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02770a06-61b5-4a9a-b5ea-40b64b831973 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:53.964538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 596/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/users/41b6c576ef7040378b6a04b6a042fb93 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:53.970210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:54.063508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:54.067458 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78775254-b1d5-41fa-9ea4-df10f2816d62 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:54.099966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a95cd-4b21-49ea-a69b-e1633aa99a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:54.100582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a95cd-4b21-49ea-a69b-e1633aa99a7a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:54.100866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a95cd-4b21-49ea-a69b-e1633aa99a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:54.101145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a95cd-4b21-49ea-a69b-e1633aa99a7a None admin] PATH_INFO: `/v3/projects/130a86f331cd467b8f5f811d4adaa271` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:54.102262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a95cd-4b21-49ea-a69b-e1633aa99a7a None admin] RBAC: Authorizing `identity:get_project(project_id=130a86f331cd467b8f5f811d4adaa271)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:54.103688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a95cd-4b21-49ea-a69b-e1633aa99a7a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:54.105326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 595/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:53 2022] GET /identity/v3/projects/130a86f331cd467b8f5f811d4adaa271 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:54.110974 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770a06-61b5-4a9a-b5ea-40b64b831973 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:54.205720 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02770a06-61b5-4a9a-b5ea-40b64b831973 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:54.238087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618629b9-36fc-4698-a531-25a184dfced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:54.238731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618629b9-36fc-4698-a531-25a184dfced9 None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:54.239009 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618629b9-36fc-4698-a531-25a184dfced9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:54.239284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618629b9-36fc-4698-a531-25a184dfced9 None admin] PATH_INFO: `/v3/projects/130a86f331cd467b8f5f811d4adaa271/users/41b6c576ef7040378b6a04b6a042fb93/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:54.241191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618629b9-36fc-4698-a531-25a184dfced9 None admin] RBAC: Authorizing `identity:create_grant(project_id=130a86f331cd467b8f5f811d4adaa271, user_id=41b6c576ef7040378b6a04b6a042fb93, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:54.242616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618629b9-36fc-4698-a531-25a184dfced9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:54.254549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 597/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:31:54 2022] PUT /identity/v3/projects/130a86f331cd467b8f5f811d4adaa271/users/41b6c576ef7040378b6a04b6a042fb93/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:31:56.126128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cff481-5144-493e-810d-85113a11ae12 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:56.126633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cff481-5144-493e-810d-85113a11ae12 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:56.126744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cff481-5144-493e-810d-85113a11ae12 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:56.128057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 596/1193] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:31:56.133067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed2c2-8a69-4fda-991e-374451326d2e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:56.133504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed2c2-8a69-4fda-991e-374451326d2e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:56.133607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ed2c2-8a69-4fda-991e-374451326d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:56.152207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-191ed2c2-8a69-4fda-991e-374451326d2e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:31:56.153403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-191ed2c2-8a69-4fda-991e-374451326d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:31:56.197871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:56.219420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 598/1194] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:31:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:31:56.483599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cff481-5144-493e-810d-85113a11ae12 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:56.583012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cff481-5144-493e-810d-85113a11ae12 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:56.615338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6929ef-209c-47d7-9529-9ce136232185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:56.615975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6929ef-209c-47d7-9529-9ce136232185 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:56.616258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6929ef-209c-47d7-9529-9ce136232185 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:56.616533 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6929ef-209c-47d7-9529-9ce136232185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:56.626914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6929ef-209c-47d7-9529-9ce136232185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-0c6929ef-209c-47d7-9529-9ce136232185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:31:56.632296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:31:56.633376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:31:56.634393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 597/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:31:56.639286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ed2c2-8a69-4fda-991e-374451326d2e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:56.733979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ed2c2-8a69-4fda-991e-374451326d2e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:56.767188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:56.767804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:56.768124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:56.768399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:56.769051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:56.769353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:56.770996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:56.778735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 599/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:31:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:56.784467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6929ef-209c-47d7-9529-9ce136232185 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:56.811671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:56.883392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6929ef-209c-47d7-9529-9ce136232185 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:56.916316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860728b-82eb-42b5-9df6-7089b8d10c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:56.916928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860728b-82eb-42b5-9df6-7089b8d10c3d None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:56.917204 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860728b-82eb-42b5-9df6-7089b8d10c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:56.917476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860728b-82eb-42b5-9df6-7089b8d10c3d None admin] PATH_INFO: `/v3/users/41b6c576ef7040378b6a04b6a042fb93` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:56.918578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860728b-82eb-42b5-9df6-7089b8d10c3d None admin] RBAC: Authorizing `identity:get_user(user_id=41b6c576ef7040378b6a04b6a042fb93)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:56.920048 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860728b-82eb-42b5-9df6-7089b8d10c3d None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:56.921605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 598/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Thu Sep 1 15:31:56 2022] GET /identity/v3/users/41b6c576ef7040378b6a04b6a042fb93 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:56.928128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:56.970907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:57.025986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc366d-9eb5-4115-bf86-f0ae56cd8f33 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:57.060392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59fa5d-0b2e-491b-af05-6f7b9927f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:57.060991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59fa5d-0b2e-491b-af05-6f7b9927f2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:57.061272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59fa5d-0b2e-491b-af05-6f7b9927f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:57.061548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59fa5d-0b2e-491b-af05-6f7b9927f2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:57.126047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59fa5d-0b2e-491b-af05-6f7b9927f2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:57.127514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59fa5d-0b2e-491b-af05-6f7b9927f2e4 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:57.166936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:57.220873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 600/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:31:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:31:57.227376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860728b-82eb-42b5-9df6-7089b8d10c3d None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:57.318823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:31:57.325632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860728b-82eb-42b5-9df6-7089b8d10c3d None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:57.358432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ddcc0-e3a8-4e08-9932-21dab66d15f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:57.359049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ddcc0-e3a8-4e08-9932-21dab66d15f7 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:57.359333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ddcc0-e3a8-4e08-9932-21dab66d15f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:57.359612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ddcc0-e3a8-4e08-9932-21dab66d15f7 None admin] PATH_INFO: `/v3/projects/130a86f331cd467b8f5f811d4adaa271` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:57.360766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ddcc0-e3a8-4e08-9932-21dab66d15f7 None admin] RBAC: Authorizing `identity:get_project(project_id=130a86f331cd467b8f5f811d4adaa271)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:57.362221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ddcc0-e3a8-4e08-9932-21dab66d15f7 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:57.363872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 599/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Thu Sep 1 15:31:57 2022] GET /identity/v3/projects/130a86f331cd467b8f5f811d4adaa271 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:31:57.369867 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59fa5d-0b2e-491b-af05-6f7b9927f2e4 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:31:57.464121 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59fa5d-0b2e-491b-af05-6f7b9927f2e4 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:31:57.496183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb70bf3-8b7b-47e5-9fd0-2b5313b58cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:31:57.496768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70bf3-8b7b-47e5-9fd0-2b5313b58cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:31:57.497043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70bf3-8b7b-47e5-9fd0-2b5313b58cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:31:57.497311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb70bf3-8b7b-47e5-9fd0-2b5313b58cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:31:57.498017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb70bf3-8b7b-47e5-9fd0-2b5313b58cb7 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=130a86f331cd467b8f5f811d4adaa271, user.id=41b6c576ef7040378b6a04b6a042fb93) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:31:57.498351 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb70bf3-8b7b-47e5-9fd0-2b5313b58cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:31:57.499764 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb70bf3-8b7b-47e5-9fd0-2b5313b58cb7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:31:57.505283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 601/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:31:57 2022] GET /identity/v3/role_assignments?user.id=41b6c576ef7040378b6a04b6a042fb93&scope.project.id=130a86f331cd467b8f5f811d4adaa271&role.id=32319452053845419798d329f1c194d4 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:32:07.354460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=19 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:07.502781 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:52.532826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575adef8-c8d4-4970-85d5-ced0f4bfb1f1 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:52.533584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575adef8-c8d4-4970-85d5-ced0f4bfb1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:52.533584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575adef8-c8d4-4970-85d5-ced0f4bfb1f1 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:52.535145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 600/1201] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:52.543888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472e652-15c3-4cda-abd2-0f5273aa91fb None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:52.543888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472e652-15c3-4cda-abd2-0f5273aa91fb None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:52.543888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472e652-15c3-4cda-abd2-0f5273aa91fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:52.561311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c472e652-15c3-4cda-abd2-0f5273aa91fb None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:52.563120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c472e652-15c3-4cda-abd2-0f5273aa91fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:52.652578 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 602/1202] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:32:52.956695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575adef8-c8d4-4970-85d5-ced0f4bfb1f1 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:53.088197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575adef8-c8d4-4970-85d5-ced0f4bfb1f1 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:53.136274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:53.137115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:53.137460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:53.137832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:53.151487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:53.153281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:32:53.172451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:53.173623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:32:53.177181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:32:53.177181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:32:53.177181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:32:53.177181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 601/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:53.180107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472e652-15c3-4cda-abd2-0f5273aa91fb None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:53.316063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472e652-15c3-4cda-abd2-0f5273aa91fb None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:53.350542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:53.356818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c3d54-a9b7-411b-a2fe-d6cf82921329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:53.357477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d54-a9b7-411b-a2fe-d6cf82921329 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:53.357825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d54-a9b7-411b-a2fe-d6cf82921329 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:53.358122 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d54-a9b7-411b-a2fe-d6cf82921329 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:53.359080 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3d54-a9b7-411b-a2fe-d6cf82921329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:53.359603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3d54-a9b7-411b-a2fe-d6cf82921329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:53.363246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3d54-a9b7-411b-a2fe-d6cf82921329 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:53.375830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 603/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:32:53.381913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:53.460060 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:53.525456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dc165-6db8-44b9-9844-83505ff9bb56 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:53.574717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b6665-8516-4a7c-a64a-be67f27655bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:53.575368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6665-8516-4a7c-a64a-be67f27655bf None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:53.575596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6665-8516-4a7c-a64a-be67f27655bf None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:53.575835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6665-8516-4a7c-a64a-be67f27655bf None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:53.576517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b6665-8516-4a7c-a64a-be67f27655bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:53.578265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b6665-8516-4a7c-a64a-be67f27655bf None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:53.615799 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 602/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Thu Sep 1 15:32:53 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:32:55.815115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d1a54-38a1-462e-b100-084a2b424ec7 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:55.815669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d1a54-38a1-462e-b100-084a2b424ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:55.815669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d1a54-38a1-462e-b100-084a2b424ec7 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:55.817103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 604/1206] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:32:55.822984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0381a1-ebc1-4387-9137-1af31f43a481 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:55.823463 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0381a1-ebc1-4387-9137-1af31f43a481 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:55.823573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0381a1-ebc1-4387-9137-1af31f43a481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:55.844641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-bd0381a1-ebc1-4387-9137-1af31f43a481 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:32:55.846093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bd0381a1-ebc1-4387-9137-1af31f43a481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:32:55.932417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 603/1207] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:32:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:32:56.231055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d1a54-38a1-462e-b100-084a2b424ec7 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:56.341761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d1a54-38a1-462e-b100-084a2b424ec7 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:56.383850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277fd6b-df90-4f1a-9c11-1bde38f224f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:56.385012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277fd6b-df90-4f1a-9c11-1bde38f224f0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:56.385630 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277fd6b-df90-4f1a-9c11-1bde38f224f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:56.386261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277fd6b-df90-4f1a-9c11-1bde38f224f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:56.400880 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277fd6b-df90-4f1a-9c11-1bde38f224f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a277fd6b-df90-4f1a-9c11-1bde38f224f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:32:56.407339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:56.408535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:32:56.412685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 605/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:32:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:56.415301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0381a1-ebc1-4387-9137-1af31f43a481 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:56.464425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:56.545491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0381a1-ebc1-4387-9137-1af31f43a481 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:56.584709 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:56.585441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:56.585754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:56.586032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:56.586696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:56.587011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:56.588478 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:56.597898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 604/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:32:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:56.603650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277fd6b-df90-4f1a-9c11-1bde38f224f0 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:56.662401 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:56.727477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277fd6b-df90-4f1a-9c11-1bde38f224f0 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:56.774292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:56.774952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:56.775258 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:56.775573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:56.791677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:56.793365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:32:56.813338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:56.814552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:32:56.815955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:32:56.815955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:32:56.815955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:32:56.815955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 606/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:56.820706 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:56.947067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:56.954833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4cf91-0fb9-48a1-bf69-6cb5ff542516 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:57.004337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:57.005057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:57.005424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:57.005698 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:57.006431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:57.007625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:57.009130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:57.023633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 605/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:57.029815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:57.154253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c689717-b086-49e3-9e6c-de18251ad48e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:57.156621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:57.199877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:57.200724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:57.201014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:57.201360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:57.210725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:57.212559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:32:57.226545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:57.227621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:32:57.228791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 607/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:32:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:32:57.238481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:57.354791 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb709e3-1405-4db4-8b0f-fd32edab76b4 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:57.408462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:57.409130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:57.409417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:57.409733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:57.410449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:57.410859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:57.412635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:57.434566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 606/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Thu Sep 1 15:32:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:57.440815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:57.564776 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a2e32-5fed-42cc-9f65-8ac3a48d0b18 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:57.601787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075a3a2-494f-4134-b47d-89de33de2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:57.602421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075a3a2-494f-4134-b47d-89de33de2d7a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:57.602728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075a3a2-494f-4134-b47d-89de33de2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:57.603062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075a3a2-494f-4134-b47d-89de33de2d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:57.640075 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:57.683294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075a3a2-494f-4134-b47d-89de33de2d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:57.684960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075a3a2-494f-4134-b47d-89de33de2d7a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:57.801898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 608/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:32:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:32:57.807695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:57.827950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:57.912194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99189d-796e-46dd-b9a6-4672933ee6c3 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:57.952624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:57.959515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:57.959515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:57.959515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:57.972084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:57.973713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:32:57.988663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:57.989646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:32:57.990567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:32:57.990567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:32:57.990567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:32:57.990567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 607/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:32:57.995606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075a3a2-494f-4134-b47d-89de33de2d7a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:58.067221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:58.113061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075a3a2-494f-4134-b47d-89de33de2d7a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:58.152519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:58.153194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:58.153515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:58.153744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:58.154570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:58.155934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:58.156341 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:58.169221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 609/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:32:58.175408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:58.263826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:58.302945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054d285-da48-4e6e-a947-dc360e0b68a0 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:58.353469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:58.354151 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:58.354426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:58.354706 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:58.363596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:58.365371 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:32:58.381248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:32:58.382313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:32:58.383356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 608/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:32:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:32:58.388916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:58.511086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672e9c3-5ea5-421d-aa1b-02a509088765 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:58.535948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:58.549410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbf250-6de9-450c-8e8d-4c45c1d8d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:58.550104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf250-6de9-450c-8e8d-4c45c1d8d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:58.550404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf250-6de9-450c-8e8d-4c45c1d8d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:58.550684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf250-6de9-450c-8e8d-4c45c1d8d3b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:58.551390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbf250-6de9-450c-8e8d-4c45c1d8d3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:58.551690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbf250-6de9-450c-8e8d-4c45c1d8d3b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:58.553317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbf250-6de9-450c-8e8d-4c45c1d8d3b2 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:58.565987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 610/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:32:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:32:58.572556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:32:58.681907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7a7ee-316c-4cea-92bf-b47474378612 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:32:58.712540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:32:58.723036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8cac8-3971-4407-85d8-25918289b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:32:58.723686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8cac8-3971-4407-85d8-25918289b2ee None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:32:58.724001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8cac8-3971-4407-85d8-25918289b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:32:58.724273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8cac8-3971-4407-85d8-25918289b2ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:32:58.725216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8cac8-3971-4407-85d8-25918289b2ee None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=99ee78db03794fbcb572ca1e98f231fa) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:32:58.725426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8cac8-3971-4407-85d8-25918289b2ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:32:58.726947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8cac8-3971-4407-85d8-25918289b2ee None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:32:58.733692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 609/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:32:58 2022] GET /identity/v3/role_assignments?user.id=99ee78db03794fbcb572ca1e98f231fa&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:00.727679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd4b-8ab8-4939-ac4f-d9a5c7a9008c None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:00.728242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd4b-8ab8-4939-ac4f-d9a5c7a9008c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:00.728242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd4b-8ab8-4939-ac4f-d9a5c7a9008c None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:00.729580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 611/1220] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:00.734811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f916-dce0-4f16-9fa6-2c6dcbda227a None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:00.735223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f916-dce0-4f16-9fa6-2c6dcbda227a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:00.735397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f916-dce0-4f16-9fa6-2c6dcbda227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:00.755154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-9e95f916-dce0-4f16-9fa6-2c6dcbda227a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:00.756378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9e95f916-dce0-4f16-9fa6-2c6dcbda227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:00.824405 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 610/1221] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:01.099083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fdd4b-8ab8-4939-ac4f-d9a5c7a9008c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:01.201500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fdd4b-8ab8-4939-ac4f-d9a5c7a9008c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:01.238527 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e57c5-297b-4616-82d5-fb471f559c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:01.239150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e57c5-297b-4616-82d5-fb471f559c82 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:01.239432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e57c5-297b-4616-82d5-fb471f559c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:01.239700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e57c5-297b-4616-82d5-fb471f559c82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:01.251058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e57c5-297b-4616-82d5-fb471f559c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-3e6e57c5-297b-4616-82d5-fb471f559c82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:01.258656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:01.259847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:01.260873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 612/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:33:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:01.266346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95f916-dce0-4f16-9fa6-2c6dcbda227a None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:01.371277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95f916-dce0-4f16-9fa6-2c6dcbda227a None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:01.399529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:01.414517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:01.415361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:01.415932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:01.416416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:01.417070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] RBAC: Adding query filter params (name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:01.417385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:01.418761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:01.427637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 611/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:33:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:01.433551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e57c5-297b-4616-82d5-fb471f559c82 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:01.477416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:01.542396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e57c5-297b-4616-82d5-fb471f559c82 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:01.581509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:01.582247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:01.582591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:01.582898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:01.594888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:01.596568 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:01.613457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:01.614877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:01.615904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:01.615904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:01.615904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:01.615904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 613/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:33:01.620753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:01.726704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c922a-a62c-49a4-b176-9fa87369c848 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:01.762950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719812-0a27-4919-805f-090061ea382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:01.763606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719812-0a27-4919-805f-090061ea382a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:01.763915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719812-0a27-4919-805f-090061ea382a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:01.764279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719812-0a27-4919-805f-090061ea382a None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:01.765038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c719812-0a27-4919-805f-090061ea382a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:01.765393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c719812-0a27-4919-805f-090061ea382a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:01.767294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c719812-0a27-4919-805f-090061ea382a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:01.782555 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 612/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:01.787205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:01.890069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:01.898660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462b11c-5df4-4ed8-82ae-6c99ac5a1b50 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:01.934996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:01.935685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:01.936003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:01.936296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:01.943857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:01.945328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:01.958074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:01.959207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:01.960610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 614/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:01.965182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719812-0a27-4919-805f-090061ea382a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:02.025295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:02.081997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719812-0a27-4919-805f-090061ea382a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:02.119286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:02.119949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:02.120221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:02.120555 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:02.121378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:02.121713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:02.123323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:02.142721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 613/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:02.148651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:02.251563 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb20c-6376-4ff6-8387-7a7f60a20195 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:02.287196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:02.287810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:02.288116 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:02.288445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:02.300181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:02.301736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:02.317839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:02.319176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:02.320522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:02.320522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:02.320522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:02.322055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 615/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:02.328522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:02.439578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd2f22-d7c3-4c5d-bbd9-a7f31f0dbb33 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:02.442587 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:02.479243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:02.479895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:02.480176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:02.480448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:02.481104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:02.481411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:02.482788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:02.495019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 614/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:02.501526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:02.512224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:02.612095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa11b2-5575-4689-a0df-5eb8a508e6b0 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:02.655241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:02.655916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:02.656203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:02.656481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:02.663926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:02.665656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:02.679522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:02.680696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:02.681614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 616/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:02.689691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:02.792275 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a48a4-a6fe-482c-ba3b-1e76c45cc3f5 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:02.828799 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba96fd-ffd5-4b57-8a6b-88e5e7e280d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:02.829378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba96fd-ffd5-4b57-8a6b-88e5e7e280d0 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:02.829732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba96fd-ffd5-4b57-8a6b-88e5e7e280d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:02.829939 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba96fd-ffd5-4b57-8a6b-88e5e7e280d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:02.830632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba96fd-ffd5-4b57-8a6b-88e5e7e280d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:02.830944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba96fd-ffd5-4b57-8a6b-88e5e7e280d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:02.832411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba96fd-ffd5-4b57-8a6b-88e5e7e280d0 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:02.845428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 615/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:02.851828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:02.921200 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:02.956943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0ecb-4ac7-433a-89df-d4a6cf7d6ea0 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:02.993072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00586d-ecc6-4be7-84f7-ecf97aac1980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:02.993762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00586d-ecc6-4be7-84f7-ecf97aac1980 None admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:02.994087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00586d-ecc6-4be7-84f7-ecf97aac1980 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:02.994364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00586d-ecc6-4be7-84f7-ecf97aac1980 None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/99ee78db03794fbcb572ca1e98f231fa/roles/c96f60a1a9284a17862e2507df5b15f0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:03.010705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00586d-ecc6-4be7-84f7-ecf97aac1980 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=99ee78db03794fbcb572ca1e98f231fa, role_id=c96f60a1a9284a17862e2507df5b15f0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:03.012370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00586d-ecc6-4be7-84f7-ecf97aac1980 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:03.025145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 617/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:33:02 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/99ee78db03794fbcb572ca1e98f231fa/roles/c96f60a1a9284a17862e2507df5b15f0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:33:05.047119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360264e-aa72-41d1-8e27-5b757aa2ff13 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:05.047688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360264e-aa72-41d1-8e27-5b757aa2ff13 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:05.047688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360264e-aa72-41d1-8e27-5b757aa2ff13 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:05.049200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 616/1233] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:05.054487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347d32-bff0-4d9c-b870-412269847e58 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:05.054939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347d32-bff0-4d9c-b870-412269847e58 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:05.055031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347d32-bff0-4d9c-b870-412269847e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:05.074819 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-9e347d32-bff0-4d9c-b870-412269847e58 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:05.076063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9e347d32-bff0-4d9c-b870-412269847e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:05.149429 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 618/1234] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:05.418584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360264e-aa72-41d1-8e27-5b757aa2ff13 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:05.450600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:05.540882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360264e-aa72-41d1-8e27-5b757aa2ff13 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:05.580296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd4b1-0840-47a0-aae3-7947477ef107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:05.581003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd4b1-0840-47a0-aae3-7947477ef107 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:05.581401 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd4b1-0840-47a0-aae3-7947477ef107 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:05.581752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd4b1-0840-47a0-aae3-7947477ef107 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:05.594313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd4b1-0840-47a0-aae3-7947477ef107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-d9ffd4b1-0840-47a0-aae3-7947477ef107 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:05.599660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:05.600722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:05.601573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 617/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Thu Sep 1 15:33:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:05.607004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e347d32-bff0-4d9c-b870-412269847e58 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:05.666014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:05.733254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e347d32-bff0-4d9c-b870-412269847e58 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:05.773193 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:05.773793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:05.774070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:05.774340 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:05.774995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:05.775293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:05.776757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:05.784744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 619/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Thu Sep 1 15:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:05.790685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd4b1-0840-47a0-aae3-7947477ef107 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:05.883418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:05.904239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd4b1-0840-47a0-aae3-7947477ef107 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:05.942742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:05.943497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:05.943880 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:05.944221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:05.956566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:05.958050 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:05.974679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:05.979929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:05.981107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:05.981107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:05.981107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:05.981107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 618/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:33:05.981969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:06.087983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1fdc-cc45-4c76-adfd-c54a514873c8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:06.098929 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:06.127796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:06.128416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:06.128699 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:06.128976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:06.129631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:06.129938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:06.131316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:06.144029 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 620/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:06.150099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:06.253196 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e528dea-e352-43d2-bdfe-c0b6bbc97309 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:06.289544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:06.290199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:06.290526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:06.290757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:06.293582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:06.299711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:06.301411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:06.313845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:06.314891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:06.316258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 619/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:06.321439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:06.432115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eec024-983b-4472-bf1a-c9134b842e51 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:06.470220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:06.470869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:06.471103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:06.471383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:06.472172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:06.472454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:06.473879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:06.490756 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 621/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:06.496678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:06.616094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14104ec8-2b30-403d-bcfc-490a67861032 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:06.656937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54c51d-f23e-47f3-865b-bbd58888a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:06.657487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c51d-f23e-47f3-865b-bbd58888a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:06.657798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c51d-f23e-47f3-865b-bbd58888a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:06.658136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c51d-f23e-47f3-865b-bbd58888a9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:06.723362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:06.730525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54c51d-f23e-47f3-865b-bbd58888a9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:06.732181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54c51d-f23e-47f3-865b-bbd58888a9e8 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:06.839230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 620/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:33:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:33:06.845749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:06.875073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:06.949210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e368-3a16-4c52-8aee-1773c39bd68e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:06.988493 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:06.989000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:06.989284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:06.989559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:07.000849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:07.002437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:07.019899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:07.021102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:07.022135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:07.022135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:07.022135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:07.022135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 622/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:07.026969 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54c51d-f23e-47f3-865b-bbd58888a9e8 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:07.137810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:07.145872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54c51d-f23e-47f3-865b-bbd58888a9e8 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:07.184184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:07.184848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:07.185185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:07.185578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:07.187055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:07.187503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:07.189417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:07.203483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 621/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:07.209118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:07.298523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:07.322731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82df664-7bb9-47eb-a02f-7f49855aa40e None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:07.360060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:07.360694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:07.360979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:07.361250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:07.367852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:07.369310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:07.380950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:07.382145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:07.383427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:07.383427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:07.383427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:07.383427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:07.383427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:07.383427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:07.383427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:07.383427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:07.387851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 623/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:07.388000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:07.500467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f6bfd-82cc-47cf-9315-e53d1fa5fd3a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:07.536308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5280db-b5f6-4f47-a0e4-15bdd6d36a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:07.536923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5280db-b5f6-4f47-a0e4-15bdd6d36a6a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:07.537203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5280db-b5f6-4f47-a0e4-15bdd6d36a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:07.537476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5280db-b5f6-4f47-a0e4-15bdd6d36a6a None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:07.538172 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5280db-b5f6-4f47-a0e4-15bdd6d36a6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:07.538481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5280db-b5f6-4f47-a0e4-15bdd6d36a6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:07.539996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5280db-b5f6-4f47-a0e4-15bdd6d36a6a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:07.557789 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 622/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:07.559478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:07.675888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7c858-1a11-47a7-8ae1-9d54854e086a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:07.713032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2db5b-9669-454d-afc1-a3c61056621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:07.713801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2db5b-9669-454d-afc1-a3c61056621c None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:07.714194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2db5b-9669-454d-afc1-a3c61056621c None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:07.714513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2db5b-9669-454d-afc1-a3c61056621c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:07.715389 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2db5b-9669-454d-afc1-a3c61056621c None admin] RBAC: Adding query filter params (role.id=c96f60a1a9284a17862e2507df5b15f0, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=99ee78db03794fbcb572ca1e98f231fa) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:07.715797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2db5b-9669-454d-afc1-a3c61056621c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:07.718350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2db5b-9669-454d-afc1-a3c61056621c None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:07.724822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 624/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:33:07 2022] GET /identity/v3/role_assignments?user.id=99ee78db03794fbcb572ca1e98f231fa&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=c96f60a1a9284a17862e2507df5b15f0 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:09.771827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a24b2d-7b3a-4c5f-8de4-2bda41c60bed None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:09.771827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a24b2d-7b3a-4c5f-8de4-2bda41c60bed None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:09.771827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a24b2d-7b3a-4c5f-8de4-2bda41c60bed None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:09.772527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 623/1247] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:09.777302 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39069ce-6f3b-448e-b11b-cdf7a4a54e61 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:09.777758 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39069ce-6f3b-448e-b11b-cdf7a4a54e61 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:09.777853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39069ce-6f3b-448e-b11b-cdf7a4a54e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:09.784765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:09.798837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-a39069ce-6f3b-448e-b11b-cdf7a4a54e61 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:09.800070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-a39069ce-6f3b-448e-b11b-cdf7a4a54e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:09.874680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 625/1248] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:10.143475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a24b2d-7b3a-4c5f-8de4-2bda41c60bed None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:10.162916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:10.255042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a24b2d-7b3a-4c5f-8de4-2bda41c60bed None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:10.295723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a1df-eaac-47ba-9242-82b83f662e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:10.296378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a1df-eaac-47ba-9242-82b83f662e56 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:10.296649 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a1df-eaac-47ba-9242-82b83f662e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:10.296922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a1df-eaac-47ba-9242-82b83f662e56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:10.307662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046a1df-eaac-47ba-9242-82b83f662e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-9046a1df-eaac-47ba-9242-82b83f662e56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:10.312547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:10.313777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:10.314782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 624/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:10.321030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39069ce-6f3b-448e-b11b-cdf7a4a54e61 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:10.436607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39069ce-6f3b-448e-b11b-cdf7a4a54e61 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:10.476729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:10.483559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:10.484430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:10.484715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:10.484991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:10.485782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:10.486153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:10.487961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:10.498806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 626/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:10.504647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a1df-eaac-47ba-9242-82b83f662e56 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:10.584849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:10.608379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a1df-eaac-47ba-9242-82b83f662e56 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:10.647879 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:10.648681 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:10.648962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:10.649236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:10.660276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:10.661729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:10.676954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:10.682859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:10.683867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:10.683867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:10.683867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:10.683867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 625/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:10.684110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:10.791741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f9a1-13ef-4774-9d1f-191e22741c4a None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:10.829118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:10.830716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:10.830716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:10.830716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:10.831183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:10.831488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:10.832918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:10.848145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 627/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:10.854178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:10.971321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4d4ae-f0ba-47ce-8c3a-b7aad40f3426 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:11.001280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:11.010306 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:11.011032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:11.011358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:11.011636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:11.020447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:11.021894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:11.033345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:11.034451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:11.035650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 626/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:11.040356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:11.103251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:11.150463 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9942e-06a5-4fd3-93ac-8391fb968497 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:11.190422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:11.191103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:11.191480 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:11.191843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:11.192785 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:11.193205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:11.194821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:11.215395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 628/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:11.221835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:11.322706 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463651e-5ebc-4328-92f0-b4fd2d46bf44 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:11.358672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4d858-4f11-492a-ab1b-2097e3267a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:11.359214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4d858-4f11-492a-ab1b-2097e3267a40 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:11.359554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4d858-4f11-492a-ab1b-2097e3267a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:11.359968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4d858-4f11-492a-ab1b-2097e3267a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:11.424977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:11.439619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4d858-4f11-492a-ab1b-2097e3267a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:11.441163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4d858-4f11-492a-ab1b-2097e3267a40 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:11.545727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 627/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:33:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 15:33:11.551815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:11.659900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ffcda-b84e-44db-8692-12dfd1c35cdd None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:11.675292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:11.698870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:11.699565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:11.699947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:11.700278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:11.712885 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:11.714682 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:11.730445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:11.731654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:11.732812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:11.732812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:11.732812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:11.732812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 629/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:11.737802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4d858-4f11-492a-ab1b-2097e3267a40 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:11.829612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:11.843970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4d858-4f11-492a-ab1b-2097e3267a40 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:11.878282 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:11.878970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:11.879320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:11.879595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:11.880269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:11.880618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:11.882066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:11.894301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 628/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:11.900508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:12.015644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1fb8-bb49-4299-8341-a3c504ec2199 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:12.051706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:12.052376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:12.052655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:12.052926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:12.060273 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:12.062297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:12.074519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:12.075547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:12.077099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 630/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:12.082311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:12.187114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a52c58-81aa-40e1-bdb6-e88eadff1bda None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:12.222322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9693218-7c41-4604-9cc9-58ef1b7a2fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:12.222852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9693218-7c41-4604-9cc9-58ef1b7a2fdb None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:12.223132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9693218-7c41-4604-9cc9-58ef1b7a2fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:12.223403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9693218-7c41-4604-9cc9-58ef1b7a2fdb None admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:12.224151 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9693218-7c41-4604-9cc9-58ef1b7a2fdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:12.224460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9693218-7c41-4604-9cc9-58ef1b7a2fdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:12.225905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9693218-7c41-4604-9cc9-58ef1b7a2fdb None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:12.238815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 629/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:12.245013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:12.273486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:12.350344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff3642-b734-46c8-87d5-b5eb2dc39b03 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:12.387016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e1e85-d249-4602-b22a-d00b8defc0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:12.387693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1e85-d249-4602-b22a-d00b8defc0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:12.389367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1e85-d249-4602-b22a-d00b8defc0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:12.389367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1e85-d249-4602-b22a-d00b8defc0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:12.389367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e1e85-d249-4602-b22a-d00b8defc0d9 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=99ee78db03794fbcb572ca1e98f231fa) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:12.389367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e1e85-d249-4602-b22a-d00b8defc0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:12.390811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e1e85-d249-4602-b22a-d00b8defc0d9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:12.397364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 631/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:33:12 2022] GET /identity/v3/role_assignments?user.id=99ee78db03794fbcb572ca1e98f231fa&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=32319452053845419798d329f1c194d4 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:14.272214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d19d88-ddcb-42a9-881b-7238f1f9e7bb None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:14.272713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d19d88-ddcb-42a9-881b-7238f1f9e7bb None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:14.272713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d19d88-ddcb-42a9-881b-7238f1f9e7bb None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:14.274023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 630/1261] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:14.279533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921226d-f1f7-419a-b0b7-14b5c3b15d78 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:14.279932 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921226d-f1f7-419a-b0b7-14b5c3b15d78 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:14.280130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921226d-f1f7-419a-b0b7-14b5c3b15d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:14.298980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f921226d-f1f7-419a-b0b7-14b5c3b15d78 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:14.300199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f921226d-f1f7-419a-b0b7-14b5c3b15d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:14.363655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 632/1262] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:14.634662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d19d88-ddcb-42a9-881b-7238f1f9e7bb None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:14.646211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:14.733112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d19d88-ddcb-42a9-881b-7238f1f9e7bb None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:14.765406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f86b52-890f-44a2-bc2b-4b2cd5626d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:14.766019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f86b52-890f-44a2-bc2b-4b2cd5626d2e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:14.766563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f86b52-890f-44a2-bc2b-4b2cd5626d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:14.766837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f86b52-890f-44a2-bc2b-4b2cd5626d2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:14.776499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f86b52-890f-44a2-bc2b-4b2cd5626d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-16f86b52-890f-44a2-bc2b-4b2cd5626d2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:14.781860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:14.782933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:14.783979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 631/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:33:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:14.789592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921226d-f1f7-419a-b0b7-14b5c3b15d78 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:14.807227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:14.884757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921226d-f1f7-419a-b0b7-14b5c3b15d78 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:14.918098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:14.918696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:14.918979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:14.919255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:14.920004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:14.920312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:14.921679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:14.929435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 633/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:14.935061 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f86b52-890f-44a2-bc2b-4b2cd5626d2e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:15.000282 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:15.032265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f86b52-890f-44a2-bc2b-4b2cd5626d2e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:15.064600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:15.065215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:15.065492 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:15.065763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:15.075247 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:15.077229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:15.092022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:15.093161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:15.094346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:15.094346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:15.094346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:15.094346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 632/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:15.098954 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:15.176762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:15.195890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b357b-32f2-4f91-ac8b-3fbbb65721ba None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:15.228428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:15.229025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:15.229305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:15.229579 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:15.230210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:15.230513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:15.231906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:15.243230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 634/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:15.249464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:15.345098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3ea3-6209-4082-a19b-e7433061989a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:15.363959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:15.378276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:15.378955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:15.379270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:15.379543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:15.387999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:15.389663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:15.401294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:15.402640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:15.403871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 633/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:15.408297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:15.505367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816003d-d6c4-4871-a8d2-b05750840257 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:15.537081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:15.537674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:15.537949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:15.538218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:15.538934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:15.539235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:15.540713 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:15.549488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:15.558363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 635/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:15.564544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:15.662435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf88c-716d-4323-a318-5bb5f446bf8c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:15.695129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:15.695737 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:15.696048 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:15.696322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:15.706326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:15.707750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:15.721761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:15.722837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:15.723951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:15.723951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:15.723951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:15.723951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 634/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:15.728550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:15.824831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df73bbe-b79f-455f-a0b0-b33e6ada0fb9 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:15.858206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:15.858798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:15.859081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:15.859358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:15.860022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:15.860330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:15.861694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:15.872435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 636/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:15.877923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:15.909026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:15.977454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057a37d-e819-4b79-b88e-ae7becc0edc6 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:16.009649 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:16.010273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:16.010554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:16.010824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:16.017494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:16.018909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:16.030437 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:16.031447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:16.032920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 635/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:16.037321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:16.094514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:16.133848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eb405-5579-4dfd-a15c-4093d4a831a7 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:16.166658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e43c2-9808-46d4-87b4-403292f2e661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:16.167252 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e43c2-9808-46d4-87b4-403292f2e661 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:16.167535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e43c2-9808-46d4-87b4-403292f2e661 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:16.167831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e43c2-9808-46d4-87b4-403292f2e661 None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:16.168521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e43c2-9808-46d4-87b4-403292f2e661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:16.168827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e43c2-9808-46d4-87b4-403292f2e661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:16.170285 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e43c2-9808-46d4-87b4-403292f2e661 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:16.181612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 637/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:16.187423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:16.276170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:16.285526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff7103-157c-4dc0-9f3b-bae36a44705c None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:16.317544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aac1f9-1d03-47c4-a5c7-308533101f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:16.318191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac1f9-1d03-47c4-a5c7-308533101f93 None admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:16.318482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac1f9-1d03-47c4-a5c7-308533101f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:16.318758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac1f9-1d03-47c4-a5c7-308533101f93 None admin] PATH_INFO: `/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/99ee78db03794fbcb572ca1e98f231fa/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:16.320689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac1f9-1d03-47c4-a5c7-308533101f93 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab172e9e6ef64f71bac198db64a713e9, user_id=99ee78db03794fbcb572ca1e98f231fa, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:16.322130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac1f9-1d03-47c4-a5c7-308533101f93 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:16.335416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 636/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Thu Sep 1 15:33:16 2022] PUT /identity/v3/projects/ab172e9e6ef64f71bac198db64a713e9/users/99ee78db03794fbcb572ca1e98f231fa/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:33:18.196943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79eea-a021-4311-8e2a-755154586a08 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:18.197492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79eea-a021-4311-8e2a-755154586a08 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:18.197492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79eea-a021-4311-8e2a-755154586a08 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:18.198832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 638/1274] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:18.204599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515781e-1fb0-487c-8524-ab7fda03f99c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:18.205013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515781e-1fb0-487c-8524-ab7fda03f99c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:18.205117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515781e-1fb0-487c-8524-ab7fda03f99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:18.223439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5515781e-1fb0-487c-8524-ab7fda03f99c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:18.224646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5515781e-1fb0-487c-8524-ab7fda03f99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:18.289180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 637/1275] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 15:33:18.554155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef79eea-a021-4311-8e2a-755154586a08 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:18.651326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef79eea-a021-4311-8e2a-755154586a08 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:18.668213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:18.685024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeed7b-f78a-43aa-8792-7c53c4965d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:18.685639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeed7b-f78a-43aa-8792-7c53c4965d6b None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:18.685921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeed7b-f78a-43aa-8792-7c53c4965d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:18.686196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeed7b-f78a-43aa-8792-7c53c4965d6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:18.695908 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeed7b-f78a-43aa-8792-7c53c4965d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-fafeed7b-f78a-43aa-8792-7c53c4965d6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 15:33:18.700696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:18.701783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:18.702813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 639/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Thu Sep 1 15:33:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:18.707521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515781e-1fb0-487c-8524-ab7fda03f99c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:18.786051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:18.805703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515781e-1fb0-487c-8524-ab7fda03f99c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:18.838140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:18.838737 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:18.839017 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:18.839292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:18.839982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:18.840291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:18.842145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:18.849966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 638/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Thu Sep 1 15:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:18.855445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeed7b-f78a-43aa-8792-7c53c4965d6b None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:18.950098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeed7b-f78a-43aa-8792-7c53c4965d6b None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:18.983679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:18.984322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:18.984598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:18.984867 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:18.994348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:18.995803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:19.009709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:19.010812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:19.011808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:19.011808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:19.011808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:19.011808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 640/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:19.016876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:19.118709 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f031e-e43e-4291-a988-448efa9cd343 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:19.151258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:19.151885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:19.152171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:19.152446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:19.153083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:19.153389 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:19.155368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:19.166658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 639/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:19.172246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:19.202293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:19.270098 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a0374-2cd5-4352-9219-97114348a496 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:19.302432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:19.303048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:19.303331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:19.303606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:19.310783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:19.312267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 15:33:19.323074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:19.324174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:19.325471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 641/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:19.330442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:19.334160 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:19.426379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8cea6-ebd3-4c32-a125-169700c21b75 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:19.459471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:19.460107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:19.460387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:19.460657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:19.461376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:19.461678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:19.463075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:19.479170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 640/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Thu Sep 1 15:33:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:19.484774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:19.572952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:19.583134 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f6dc6-2f1e-43ec-a00c-e336892a9ea6 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:19.614723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bff01-e4ff-4191-834e-4c75d3d0352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:19.615315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bff01-e4ff-4191-834e-4c75d3d0352d None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:19.615596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bff01-e4ff-4191-834e-4c75d3d0352d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:19.615908 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bff01-e4ff-4191-834e-4c75d3d0352d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:19.679938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bff01-e4ff-4191-834e-4c75d3d0352d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:19.681321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bff01-e4ff-4191-834e-4c75d3d0352d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:19.767177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:19.777227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 642/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Thu Sep 1 15:33:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 15:33:19.783008 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:19.842874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:19.880787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332cd60-0ab9-4d39-a649-2df12e1d8b29 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:19.913130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:19.913781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:19.914063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:19.914338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:19.924463 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:19.925903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 15:33:19.941515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:19.942616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 15:33:19.943541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 15:33:19.943541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 15:33:19.943541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:19.943541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 641/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:19.948186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bff01-e4ff-4191-834e-4c75d3d0352d None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:20.042653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bff01-e4ff-4191-834e-4c75d3d0352d None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:20.075750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:20.076372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:20.076654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:20.076926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:20.077557 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:20.077861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:20.079222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:20.089958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 643/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Thu Sep 1 15:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:20.095605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:20.192407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bc789-dbce-42d7-a495-9be4e0e48e88 None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:20.205212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:20.225052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:20.225663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:20.225944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:20.226223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:20.233206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:20.234631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 15:33:20.245554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:20.246592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: ERROR keystone.server.flask.application Sep 01 15:33:20.247700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 642/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Thu Sep 1 15:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:20.252322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:20.301351 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:20.350086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ea388-c050-4b08-83b2-dc33ae0a14ec None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:20.382569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359f4ea-0a87-433b-ae44-7e628056407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:20.383167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359f4ea-0a87-433b-ae44-7e628056407e None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:20.383445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359f4ea-0a87-433b-ae44-7e628056407e None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:20.383716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359f4ea-0a87-433b-ae44-7e628056407e None admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:20.384454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359f4ea-0a87-433b-ae44-7e628056407e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:20.384759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359f4ea-0a87-433b-ae44-7e628056407e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:20.386174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359f4ea-0a87-433b-ae44-7e628056407e None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:20.397967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 644/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Thu Sep 1 15:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:20.404406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:20.501010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82f9a4-458c-4f7a-8965-f92d35f7d91e None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:20.533373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18b413-769b-4a14-ad2a-f151e5ccde35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:20.533963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18b413-769b-4a14-ad2a-f151e5ccde35 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:20.534244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18b413-769b-4a14-ad2a-f151e5ccde35 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:20.534516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18b413-769b-4a14-ad2a-f151e5ccde35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:20.535232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18b413-769b-4a14-ad2a-f151e5ccde35 None admin] RBAC: Adding query filter params (role.id=32319452053845419798d329f1c194d4, scope.project.id=ab172e9e6ef64f71bac198db64a713e9, user.id=99ee78db03794fbcb572ca1e98f231fa) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:20.535547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18b413-769b-4a14-ad2a-f151e5ccde35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:20.536993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18b413-769b-4a14-ad2a-f151e5ccde35 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:20.542502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 643/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Thu Sep 1 15:33:20 2022] GET /identity/v3/role_assignments?user.id=99ee78db03794fbcb572ca1e98f231fa&scope.project.id=ab172e9e6ef64f71bac198db64a713e9&role.id=32319452053845419798d329f1c194d4 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:22.425072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f39f-99c6-4776-922b-8d721e3cce65 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:22.425677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f39f-99c6-4776-922b-8d721e3cce65 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:22.425677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f39f-99c6-4776-922b-8d721e3cce65 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:22.426961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 645/1288] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:22.431916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061f87-0cd8-43df-82df-7b8b07583231 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:22.432312 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061f87-0cd8-43df-82df-7b8b07583231 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:22.432468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061f87-0cd8-43df-82df-7b8b07583231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:22.451247 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-ac061f87-0cd8-43df-82df-7b8b07583231 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:22.452457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ac061f87-0cd8-43df-82df-7b8b07583231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:22.481086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:22.518668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 644/1289] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:22.790433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948f39f-99c6-4776-922b-8d721e3cce65 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:22.887762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948f39f-99c6-4776-922b-8d721e3cce65 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:22.898224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:22.921790 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:22.922408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:22.922690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:22.922965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:22.923537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:22.924934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:22.933450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:22.934799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:22.936525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 646/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:33:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:22.940946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061f87-0cd8-43df-82df-7b8b07583231 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:23.036192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061f87-0cd8-43df-82df-7b8b07583231 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:23.069650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6406a-d2fa-430f-a83c-e625108e3d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:23.070205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6406a-d2fa-430f-a83c-e625108e3d5a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:23.070475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6406a-d2fa-430f-a83c-e625108e3d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:23.070745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6406a-d2fa-430f-a83c-e625108e3d5a None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:23.071370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6406a-d2fa-430f-a83c-e625108e3d5a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:23.071671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6406a-d2fa-430f-a83c-e625108e3d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:23.073059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6406a-d2fa-430f-a83c-e625108e3d5a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:23.077779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 645/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Thu Sep 1 15:33:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:23.083426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:23.180859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55288e-ecbb-4c8b-86d1-ba6975659886 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:23.212723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c08f2-5e12-41de-b234-144c4b9b9aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:23.213326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c08f2-5e12-41de-b234-144c4b9b9aea None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:23.213605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c08f2-5e12-41de-b234-144c4b9b9aea None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:23.213878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c08f2-5e12-41de-b234-144c4b9b9aea None admin] PATH_INFO: `/v3/services` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:23.214499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c08f2-5e12-41de-b234-144c4b9b9aea None admin] RBAC: Adding query filter params (type=placement) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:23.214799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c08f2-5e12-41de-b234-144c4b9b9aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:23.216698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c08f2-5e12-41de-b234-144c4b9b9aea None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:23.220942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 647/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Thu Sep 1 15:33:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:25.096037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead207-0a31-4525-a5b5-06ebbe6062a6 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:25.096546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead207-0a31-4525-a5b5-06ebbe6062a6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:25.096652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead207-0a31-4525-a5b5-06ebbe6062a6 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:25.097930 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 646/1293] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:25.102917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1980e0-8aa3-4421-aab4-f7792eee248e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:25.103347 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1980e0-8aa3-4421-aab4-f7792eee248e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:25.103452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1980e0-8aa3-4421-aab4-f7792eee248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:25.121731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-1d1980e0-8aa3-4421-aab4-f7792eee248e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:25.123524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1d1980e0-8aa3-4421-aab4-f7792eee248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:25.153751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:25.190294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 648/1294] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:25.458087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead207-0a31-4525-a5b5-06ebbe6062a6 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:25.489344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:25.557872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead207-0a31-4525-a5b5-06ebbe6062a6 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:25.589869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53340d8-5ced-464d-83cd-84cdd8578022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:25.590462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53340d8-5ced-464d-83cd-84cdd8578022 None admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:25.591249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53340d8-5ced-464d-83cd-84cdd8578022 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:25.591529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53340d8-5ced-464d-83cd-84cdd8578022 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:25.592209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53340d8-5ced-464d-83cd-84cdd8578022 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:25.593560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53340d8-5ced-464d-83cd-84cdd8578022 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:25.607560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 647/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Thu Sep 1 15:33:25 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:33:27.504049 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d343af-b2c2-4830-9c68-1a18d4cd4d2a None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:27.504592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d343af-b2c2-4830-9c68-1a18d4cd4d2a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:27.504592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d343af-b2c2-4830-9c68-1a18d4cd4d2a None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:27.505948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 649/1296] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:27.511023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6840-f5dd-4797-a3ee-d303b5014484 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:27.511431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6840-f5dd-4797-a3ee-d303b5014484 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:27.511571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6840-f5dd-4797-a3ee-d303b5014484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:27.530977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-dabb6840-f5dd-4797-a3ee-d303b5014484 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:27.532180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-dabb6840-f5dd-4797-a3ee-d303b5014484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:27.601452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 648/1297] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:27.863297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d343af-b2c2-4830-9c68-1a18d4cd4d2a None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:27.963969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d343af-b2c2-4830-9c68-1a18d4cd4d2a None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:27.997388 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:27.998009 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:27.998289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:27.998570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:27.999147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:28.000546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:28.009022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:28.010004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:28.011326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 650/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:33:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 15:33:28.016349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb6840-f5dd-4797-a3ee-d303b5014484 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:28.034525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:28.112142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb6840-f5dd-4797-a3ee-d303b5014484 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:28.144669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:28.145205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:28.145482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:28.145753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:28.146368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:28.146666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:28.148058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:28.152976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 649/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Thu Sep 1 15:33:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:33:28.159466 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:28.190071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:28.256580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaf4d2-c141-415d-9e3c-8d9beb05f1c8 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:28.289271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a662b1-b0e2-4254-aba5-d3b2e5829ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:28.289864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a662b1-b0e2-4254-aba5-d3b2e5829ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:28.290143 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a662b1-b0e2-4254-aba5-d3b2e5829ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:28.290415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a662b1-b0e2-4254-aba5-d3b2e5829ea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:28.291107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a662b1-b0e2-4254-aba5-d3b2e5829ea8 None admin] RBAC: Adding query filter params (interface=public, service_id=e59c37718c2047eb82f52619a7a26be4, region_id=RegionOne) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:28.291417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a662b1-b0e2-4254-aba5-d3b2e5829ea8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:28.292806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a662b1-b0e2-4254-aba5-d3b2e5829ea8 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:28.297632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 651/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Thu Sep 1 15:33:28 2022] GET /identity/v3/endpoints?service_id=e59c37718c2047eb82f52619a7a26be4&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:28.303139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:28.381760 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:28.400842 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cd9e9-8389-4409-b511-8b4b6099331a None admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:28.433511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cf497-fe56-4bc5-94f9-35fd0c5856c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:28.434106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf497-fe56-4bc5-94f9-35fd0c5856c1 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:28.434891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf497-fe56-4bc5-94f9-35fd0c5856c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:28.435160 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cf497-fe56-4bc5-94f9-35fd0c5856c1 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:28.435753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cf497-fe56-4bc5-94f9-35fd0c5856c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:28.437140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cf497-fe56-4bc5-94f9-35fd0c5856c1 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:28.443696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 650/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Thu Sep 1 15:33:28 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:33:30.312338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fae7c2-10c6-4ed7-9b2d-fbf68dd7d89a None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:30.312862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fae7c2-10c6-4ed7-9b2d-fbf68dd7d89a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:30.312862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fae7c2-10c6-4ed7-9b2d-fbf68dd7d89a None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:30.314140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 652/1302] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:33:30.319223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00fbc1-da94-4aa4-8f7a-4c2b0c30e581 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:30.319664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00fbc1-da94-4aa4-8f7a-4c2b0c30e581 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:30.319765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00fbc1-da94-4aa4-8f7a-4c2b0c30e581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:30.337979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-1d00fbc1-da94-4aa4-8f7a-4c2b0c30e581 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:33:30.339149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1d00fbc1-da94-4aa4-8f7a-4c2b0c30e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:33:30.406767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 651/1303] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:33:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 15:33:30.673246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fae7c2-10c6-4ed7-9b2d-fbf68dd7d89a None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:30.765838 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:30.772754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fae7c2-10c6-4ed7-9b2d-fbf68dd7d89a None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:30.804919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:30.805535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:30.805818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:30.806090 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:30.806665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:30.808067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 15:33:30.817053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 15:33:30.818225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application with Lock( Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self._enter() Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application return self.creator() Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application created_value = creator( Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: ERROR keystone.server.flask.application Sep 01 15:33:30.819250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 653/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Thu Sep 1 15:33:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 15:33:30.824091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00fbc1-da94-4aa4-8f7a-4c2b0c30e581 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:30.898850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:30.921907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00fbc1-da94-4aa4-8f7a-4c2b0c30e581 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:30.957592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddad42-bcc9-4185-bb9e-b03adc4e8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:30.958201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddad42-bcc9-4185-bb9e-b03adc4e8e54 None admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:30.958484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddad42-bcc9-4185-bb9e-b03adc4e8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:30.958756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddad42-bcc9-4185-bb9e-b03adc4e8e54 None admin] PATH_INFO: `/v3/services` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:30.959390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddad42-bcc9-4185-bb9e-b03adc4e8e54 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:33:30.959695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddad42-bcc9-4185-bb9e-b03adc4e8e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:30.961088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddad42-bcc9-4185-bb9e-b03adc4e8e54 None admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:30.966285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 652/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Thu Sep 1 15:33:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:33:30.972127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:33:31.068511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8f982-c2b3-450c-b4bd-ca68891deb07 None admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:33:31.099861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994080-0e45-4763-969a-07a55ddcf68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:33:31.100445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994080-0e45-4763-969a-07a55ddcf68d None admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:33:31.100723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994080-0e45-4763-969a-07a55ddcf68d None admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:33:31.100994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994080-0e45-4763-969a-07a55ddcf68d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:33:31.101640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994080-0e45-4763-969a-07a55ddcf68d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:33:31.102997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994080-0e45-4763-969a-07a55ddcf68d None admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:33:31.122732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 654/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:33:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:33:40.963236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=30 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:33:41.118408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:34.210887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543d3ac-ad6b-4318-8d86-2c48bb46490f None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:34.211545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543d3ac-ad6b-4318-8d86-2c48bb46490f None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:34.211545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543d3ac-ad6b-4318-8d86-2c48bb46490f None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:34.216476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 653/1307] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:34.218064 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194455aa-63b4-4732-a231-801b43d18fdb None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:34.218504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194455aa-63b4-4732-a231-801b43d18fdb None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:34.218684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194455aa-63b4-4732-a231-801b43d18fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:34.358656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-194455aa-63b4-4732-a231-801b43d18fdb None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:34.360747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-194455aa-63b4-4732-a231-801b43d18fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:34.504563 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 655/1308] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:34.787767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d22d-b7a7-49fc-91e4-e118f86687e5 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:34.788081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d22d-b7a7-49fc-91e4-e118f86687e5 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:34.788354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d22d-b7a7-49fc-91e4-e118f86687e5 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:34.790476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 654/1309] 10.222.0.55 () {54 vars in 965 bytes} [Thu Sep 1 15:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:34.796525 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bcd43-700a-44fb-b9fe-12f8e60bb604 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:34.796954 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bcd43-700a-44fb-b9fe-12f8e60bb604 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:34.797337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bcd43-700a-44fb-b9fe-12f8e60bb604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:34.877349 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-d79bcd43-700a-44fb-b9fe-12f8e60bb604 None None] MFA Rules not processed for user `0319076e113748d4a86e5906559abdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:34.878757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d79bcd43-700a-44fb-b9fe-12f8e60bb604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:34.904356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:34.973933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 656/1310] 10.222.0.55 () {58 vars in 1062 bytes} [Thu Sep 1 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:34.982911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782d22d-b7a7-49fc-91e4-e118f86687e5 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:34.984977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c782d22d-b7a7-49fc-91e4-e118f86687e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:35.111745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782d22d-b7a7-49fc-91e4-e118f86687e5 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:35.189203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6385432-2c25-4b1b-b6d5-207a914b67e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:35.189819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385432-2c25-4b1b-b6d5-207a914b67e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:35.190098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385432-2c25-4b1b-b6d5-207a914b67e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:35.190369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385432-2c25-4b1b-b6d5-207a914b67e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:35.192009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f6385432-2c25-4b1b-b6d5-207a914b67e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:35.247648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:35.306171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6385432-2c25-4b1b-b6d5-207a914b67e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:35.307506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6385432-2c25-4b1b-b6d5-207a914b67e1 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:35.327369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 655/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:34:37.527704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253db6c2-22ab-4e23-85d1-1fe5881f0dce None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:37.528279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253db6c2-22ab-4e23-85d1-1fe5881f0dce None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:37.528279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253db6c2-22ab-4e23-85d1-1fe5881f0dce None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:37.529619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 657/1312] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:37.535326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5f02-9eca-41fa-abd4-ddb7f7d8048b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:37.536377 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5f02-9eca-41fa-abd4-ddb7f7d8048b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:37.536739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e5f02-9eca-41fa-abd4-ddb7f7d8048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:37.628152 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5c4e5f02-9eca-41fa-abd4-ddb7f7d8048b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:37.629453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5c4e5f02-9eca-41fa-abd4-ddb7f7d8048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:37.736592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 656/1313] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:38.022562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253db6c2-22ab-4e23-85d1-1fe5881f0dce None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:38.024241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-253db6c2-22ab-4e23-85d1-1fe5881f0dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:38.127313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253db6c2-22ab-4e23-85d1-1fe5881f0dce None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:38.197600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:38.200325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dca178-4b3b-4e65-b0f3-860e87f81073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:38.201212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca178-4b3b-4e65-b0f3-860e87f81073 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:38.201721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca178-4b3b-4e65-b0f3-860e87f81073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:38.202233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca178-4b3b-4e65-b0f3-860e87f81073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:38.204033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-87dca178-4b3b-4e65-b0f3-860e87f81073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:38.316365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dca178-4b3b-4e65-b0f3-860e87f81073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:38.317739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dca178-4b3b-4e65-b0f3-860e87f81073 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:38.337749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 658/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:34:40.520416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173ee8-7b6f-4ca6-a872-03e46d20e966 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:40.520958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173ee8-7b6f-4ca6-a872-03e46d20e966 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:40.520958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173ee8-7b6f-4ca6-a872-03e46d20e966 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:40.522334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 657/1315] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:40.527457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60b27-b5e7-4028-8cae-1256ae3c30af None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:40.527894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60b27-b5e7-4028-8cae-1256ae3c30af None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:40.528058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60b27-b5e7-4028-8cae-1256ae3c30af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:40.592995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3aa60b27-b5e7-4028-8cae-1256ae3c30af None None] MFA Rules not processed for user `97526bc1651549bcba3b62f593469545`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:40.594200 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3aa60b27-b5e7-4028-8cae-1256ae3c30af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:40.645167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:40.689041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 659/1316] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:40.972128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41173ee8-7b6f-4ca6-a872-03e46d20e966 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:40.973683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-41173ee8-7b6f-4ca6-a872-03e46d20e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:40.983916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:41.079429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41173ee8-7b6f-4ca6-a872-03e46d20e966 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:41.151170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6286807-e62a-449b-8d69-1ba0ca84ee11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:41.151795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286807-e62a-449b-8d69-1ba0ca84ee11 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:41.152085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286807-e62a-449b-8d69-1ba0ca84ee11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:41.152363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6286807-e62a-449b-8d69-1ba0ca84ee11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:41.153968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a6286807-e62a-449b-8d69-1ba0ca84ee11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:41.214173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:41.260777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6286807-e62a-449b-8d69-1ba0ca84ee11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:41.262494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6286807-e62a-449b-8d69-1ba0ca84ee11 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:41.280420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 658/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:34:43.716467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a6ab-2a21-4332-af6b-a3392b2f0108 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:43.717004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a6ab-2a21-4332-af6b-a3392b2f0108 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:43.717125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a6ab-2a21-4332-af6b-a3392b2f0108 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:43.718387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 660/1318] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:43.723519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9d85-3cb5-4aef-8eaf-41dda885534a None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:43.723963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9d85-3cb5-4aef-8eaf-41dda885534a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:43.724108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9d85-3cb5-4aef-8eaf-41dda885534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:43.789803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-9bef9d85-3cb5-4aef-8eaf-41dda885534a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:43.791003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9bef9d85-3cb5-4aef-8eaf-41dda885534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:43.885640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 659/1319] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:44.167972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0a6ab-2a21-4332-af6b-a3392b2f0108 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:44.169505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4dd0a6ab-2a21-4332-af6b-a3392b2f0108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:44.269498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0a6ab-2a21-4332-af6b-a3392b2f0108 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:44.341333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8865b-8b27-4a65-b6b4-fa0cfc1a7554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:44.341940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8865b-8b27-4a65-b6b4-fa0cfc1a7554 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:44.342217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8865b-8b27-4a65-b6b4-fa0cfc1a7554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:44.342488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8865b-8b27-4a65-b6b4-fa0cfc1a7554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:44.344097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-23c8865b-8b27-4a65-b6b4-fa0cfc1a7554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:44.350842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:44.452538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8865b-8b27-4a65-b6b4-fa0cfc1a7554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:44.454013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8865b-8b27-4a65-b6b4-fa0cfc1a7554 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:44.472621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 661/1320] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:34:47.021671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21233c-3c6f-4c77-b03d-74d74e9cb696 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:47.022221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21233c-3c6f-4c77-b03d-74d74e9cb696 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:47.022221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21233c-3c6f-4c77-b03d-74d74e9cb696 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:47.024172 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 660/1321] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:47.029334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d847c-ce63-4b4d-bb52-8150f47a4a30 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:47.029731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d847c-ce63-4b4d-bb52-8150f47a4a30 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:47.029947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d847c-ce63-4b4d-bb52-8150f47a4a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:47.094560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-012d847c-ce63-4b4d-bb52-8150f47a4a30 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:47.095747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-012d847c-ce63-4b4d-bb52-8150f47a4a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:47.153544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:47.192335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 662/1322] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:34:47.491766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbcfba-d39b-4187-ac43-5d704888b37d None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:47.492088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbcfba-d39b-4187-ac43-5d704888b37d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:47.492434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbcfba-d39b-4187-ac43-5d704888b37d None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:47.493808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 661/1323] 10.222.0.55 () {54 vars in 965 bytes} [Thu Sep 1 15:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:47.499947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd83ae-71d7-4244-9a4a-7c85d4a27719 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:47.500307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd83ae-71d7-4244-9a4a-7c85d4a27719 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:47.500668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd83ae-71d7-4244-9a4a-7c85d4a27719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:47.576033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-74cd83ae-71d7-4244-9a4a-7c85d4a27719 None None] MFA Rules not processed for user `0319076e113748d4a86e5906559abdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:47.577229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-74cd83ae-71d7-4244-9a4a-7c85d4a27719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:47.653518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 663/1324] 10.222.0.55 () {58 vars in 1062 bytes} [Thu Sep 1 15:34:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:47.664005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbcfba-d39b-4187-ac43-5d704888b37d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:47.665540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-aadbcfba-d39b-4187-ac43-5d704888b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:47.685642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:47.769257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbcfba-d39b-4187-ac43-5d704888b37d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:47.841291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9563bb-731b-4ea0-b847-77bde71ea1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:47.841907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9563bb-731b-4ea0-b847-77bde71ea1ff service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:47.842189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9563bb-731b-4ea0-b847-77bde71ea1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:47.842464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9563bb-731b-4ea0-b847-77bde71ea1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:47.844110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ee9563bb-731b-4ea0-b847-77bde71ea1ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:47.915194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:47.954060 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9563bb-731b-4ea0-b847-77bde71ea1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:47.955841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9563bb-731b-4ea0-b847-77bde71ea1ff service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:47.974970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 662/1325] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:34:50.179753 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4878-d67c-40a9-9f0b-a6c9a97b4fd7 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:50.180332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4878-d67c-40a9-9f0b-a6c9a97b4fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:50.180332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4878-d67c-40a9-9f0b-a6c9a97b4fd7 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:50.181666 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 664/1326] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:50.186763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19cc8e-cfdb-4126-a1ae-2da152837b84 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:50.187181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19cc8e-cfdb-4126-a1ae-2da152837b84 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:50.187310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19cc8e-cfdb-4126-a1ae-2da152837b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:50.253285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-4a19cc8e-cfdb-4126-a1ae-2da152837b84 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:50.254417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4a19cc8e-cfdb-4126-a1ae-2da152837b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:50.357975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 663/1327] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:50.639899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d4878-d67c-40a9-9f0b-a6c9a97b4fd7 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:50.641511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-490d4878-d67c-40a9-9f0b-a6c9a97b4fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:50.701381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:50.745539 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d4878-d67c-40a9-9f0b-a6c9a97b4fd7 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:50.818350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af48f-3e26-4999-8aad-1604cedef52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:50.818963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af48f-3e26-4999-8aad-1604cedef52d service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:50.819240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af48f-3e26-4999-8aad-1604cedef52d service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:50.819509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af48f-3e26-4999-8aad-1604cedef52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:50.821118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b56af48f-3e26-4999-8aad-1604cedef52d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:50.925550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:50.928185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af48f-3e26-4999-8aad-1604cedef52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:50.929762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af48f-3e26-4999-8aad-1604cedef52d service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:50.951028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 665/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:34:52.917413 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a59b-4dd4-4782-a313-390b582c4365 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:52.917945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a59b-4dd4-4782-a313-390b582c4365 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:52.917945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a59b-4dd4-4782-a313-390b582c4365 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:52.919329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 664/1329] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:52.925046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d8e5-fc33-427c-91fb-757e7361b31f None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:52.925471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d8e5-fc33-427c-91fb-757e7361b31f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:52.925720 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d8e5-fc33-427c-91fb-757e7361b31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:52.998611 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c815d8e5-fc33-427c-91fb-757e7361b31f None None] MFA Rules not processed for user `97526bc1651549bcba3b62f593469545`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:52.999864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c815d8e5-fc33-427c-91fb-757e7361b31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:53.096092 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 666/1330] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:34:53.377723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4a59b-4dd4-4782-a313-390b582c4365 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:53.379305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f4b4a59b-4dd4-4782-a313-390b582c4365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:53.410693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:53.482302 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4a59b-4dd4-4782-a313-390b582c4365 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:53.560165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f266d5-0278-4887-bda4-4f2cfdb05e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:53.560788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f266d5-0278-4887-bda4-4f2cfdb05e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:53.561067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f266d5-0278-4887-bda4-4f2cfdb05e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:53.561344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f266d5-0278-4887-bda4-4f2cfdb05e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:53.562971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-26f266d5-0278-4887-bda4-4f2cfdb05e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:53.645713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:53.682522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f266d5-0278-4887-bda4-4f2cfdb05e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:53.684160 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f266d5-0278-4887-bda4-4f2cfdb05e1a service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:53.705158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 665/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:34:56.035364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf18fb-2509-44b5-b3d3-e1b400f3bb6c None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:56.035964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf18fb-2509-44b5-b3d3-e1b400f3bb6c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:56.035964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf18fb-2509-44b5-b3d3-e1b400f3bb6c None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:56.037296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 667/1332] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:56.042868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87031a-d505-4817-875e-1fc167754b93 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:56.043307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87031a-d505-4817-875e-1fc167754b93 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:56.043436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87031a-d505-4817-875e-1fc167754b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:56.108643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-6e87031a-d505-4817-875e-1fc167754b93 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:56.109854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6e87031a-d505-4817-875e-1fc167754b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:56.202563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 666/1333] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:56.479733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf18fb-2509-44b5-b3d3-e1b400f3bb6c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:56.482516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5edf18fb-2509-44b5-b3d3-e1b400f3bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:56.551838 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:56.585920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf18fb-2509-44b5-b3d3-e1b400f3bb6c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:56.656425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf568ee4-f114-421f-be41-b3b8ae38c97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:56.657031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf568ee4-f114-421f-be41-b3b8ae38c97e service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:56.657314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf568ee4-f114-421f-be41-b3b8ae38c97e service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:56.657591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf568ee4-f114-421f-be41-b3b8ae38c97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:56.659177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-cf568ee4-f114-421f-be41-b3b8ae38c97e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:56.764996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf568ee4-f114-421f-be41-b3b8ae38c97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:56.766374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf568ee4-f114-421f-be41-b3b8ae38c97e service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:56.776704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:56.785773 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 668/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:34:58.723872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c7f5-87bc-4c40-85b4-fa066d31090f None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:58.724442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c7f5-87bc-4c40-85b4-fa066d31090f None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:58.724442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0c7f5-87bc-4c40-85b4-fa066d31090f None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:58.726383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 667/1335] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:34:58.731673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ec75-f323-4b0b-b71c-d194ecdfd555 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:58.732095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ec75-f323-4b0b-b71c-d194ecdfd555 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:58.732263 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ec75-f323-4b0b-b71c-d194ecdfd555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:58.796414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3278ec75-f323-4b0b-b71c-d194ecdfd555 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:34:58.797595 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3278ec75-f323-4b0b-b71c-d194ecdfd555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:58.890281 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 669/1336] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:34:59.175138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c7f5-87bc-4c40-85b4-fa066d31090f None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:34:59.176772 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-27c0c7f5-87bc-4c40-85b4-fa066d31090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:59.217185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:59.279710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0c7f5-87bc-4c40-85b4-fa066d31090f None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:34:59.350467 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24299177-c72e-4d49-94d6-32a9e7e9422d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:34:59.351066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299177-c72e-4d49-94d6-32a9e7e9422d service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:34:59.351346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299177-c72e-4d49-94d6-32a9e7e9422d service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:34:59.351619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24299177-c72e-4d49-94d6-32a9e7e9422d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:34:59.353221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-24299177-c72e-4d49-94d6-32a9e7e9422d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:34:59.435047 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:34:59.461098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24299177-c72e-4d49-94d6-32a9e7e9422d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:34:59.462561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24299177-c72e-4d49-94d6-32a9e7e9422d service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:34:59.480469 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 668/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:01.713161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1e8c0-aad5-4cf5-a7ba-20d4146f2a41 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:01.713619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1e8c0-aad5-4cf5-a7ba-20d4146f2a41 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:01.713709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1e8c0-aad5-4cf5-a7ba-20d4146f2a41 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:01.715056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 670/1338] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:01.720126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372cc5-69f2-4f52-a0bb-113daad96591 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:01.720604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372cc5-69f2-4f52-a0bb-113daad96591 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:01.720701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7372cc5-69f2-4f52-a0bb-113daad96591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:01.787381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-a7372cc5-69f2-4f52-a0bb-113daad96591 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:01.789216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a7372cc5-69f2-4f52-a0bb-113daad96591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:01.883680 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 669/1339] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:02.164443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1e8c0-aad5-4cf5-a7ba-20d4146f2a41 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:02.165992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7fc1e8c0-aad5-4cf5-a7ba-20d4146f2a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:02.241833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:02.270224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1e8c0-aad5-4cf5-a7ba-20d4146f2a41 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:02.340476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6003ab-bc3b-45a1-8b37-39aa5d503101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:02.341078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6003ab-bc3b-45a1-8b37-39aa5d503101 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:02.341362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6003ab-bc3b-45a1-8b37-39aa5d503101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:02.341638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6003ab-bc3b-45a1-8b37-39aa5d503101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:02.343224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9d6003ab-bc3b-45a1-8b37-39aa5d503101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:02.452047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6003ab-bc3b-45a1-8b37-39aa5d503101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:02.453491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6003ab-bc3b-45a1-8b37-39aa5d503101 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:02.471479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 671/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:06.297532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9f643-1b97-4867-bc35-107238f055f1 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:06.297991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9f643-1b97-4867-bc35-107238f055f1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:06.298103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9f643-1b97-4867-bc35-107238f055f1 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:06.299485 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 670/1341] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:06.304882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5ef0-93a4-4602-87b0-dc9541e3501a None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:06.305280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5ef0-93a4-4602-87b0-dc9541e3501a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:06.305426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5ef0-93a4-4602-87b0-dc9541e3501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:06.310979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:06.372364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b7cd5ef0-93a4-4602-87b0-dc9541e3501a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:06.373604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b7cd5ef0-93a4-4602-87b0-dc9541e3501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:06.471253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 672/1342] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:06.751795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9f643-1b97-4867-bc35-107238f055f1 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:06.753452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d5e9f643-1b97-4867-bc35-107238f055f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:06.801834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:06.856920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9f643-1b97-4867-bc35-107238f055f1 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:06.931285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc6792-3a5e-4282-91ee-213a106bcc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:06.931933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6792-3a5e-4282-91ee-213a106bcc15 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:06.932223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6792-3a5e-4282-91ee-213a106bcc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:06.932491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6792-3a5e-4282-91ee-213a106bcc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:06.934092 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bafc6792-3a5e-4282-91ee-213a106bcc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:07.030034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:07.047388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6792-3a5e-4282-91ee-213a106bcc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:07.048869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6792-3a5e-4282-91ee-213a106bcc15 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:07.066852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 671/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:09.656499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e860e0a-7ee1-4445-879f-f038ff429fc8 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:09.657025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e860e0a-7ee1-4445-879f-f038ff429fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:09.657025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e860e0a-7ee1-4445-879f-f038ff429fc8 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:09.658393 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 673/1344] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:09.664233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109830f-c8ef-4232-9e2d-3f35442924b0 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:09.664657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109830f-c8ef-4232-9e2d-3f35442924b0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:09.664785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109830f-c8ef-4232-9e2d-3f35442924b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:09.730033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-e109830f-c8ef-4232-9e2d-3f35442924b0 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:09.731259 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-e109830f-c8ef-4232-9e2d-3f35442924b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:09.827656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 672/1345] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:10.114584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e860e0a-7ee1-4445-879f-f038ff429fc8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:10.116292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2e860e0a-7ee1-4445-879f-f038ff429fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:10.203400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:10.221335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e860e0a-7ee1-4445-879f-f038ff429fc8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:10.299698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b192d4-ba35-4689-988b-2c19f1865a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:10.300336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b192d4-ba35-4689-988b-2c19f1865a4a service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:10.300628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b192d4-ba35-4689-988b-2c19f1865a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:10.300877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b192d4-ba35-4689-988b-2c19f1865a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:10.302464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-58b192d4-ba35-4689-988b-2c19f1865a4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:10.414485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b192d4-ba35-4689-988b-2c19f1865a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:10.416118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b192d4-ba35-4689-988b-2c19f1865a4a service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:10.439224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 674/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:14.291695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6a35-d387-4c10-8141-a120313b184d None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:14.292220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6a35-d387-4c10-8141-a120313b184d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:14.292319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6a35-d387-4c10-8141-a120313b184d None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:14.293623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 673/1347] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:14.299076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de29e7-0228-4358-b30e-02b5360a378f None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:14.299496 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de29e7-0228-4358-b30e-02b5360a378f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:14.299627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de29e7-0228-4358-b30e-02b5360a378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:14.320837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:14.377626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-e7de29e7-0228-4358-b30e-02b5360a378f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:14.379166 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e7de29e7-0228-4358-b30e-02b5360a378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:14.488787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 675/1348] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:14.775445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e6a35-d387-4c10-8141-a120313b184d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:14.777036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-155e6a35-d387-4c10-8141-a120313b184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:14.835736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:14.883689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e6a35-d387-4c10-8141-a120313b184d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:14.961054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da814ffc-43fd-4f8d-9d3d-4679986f6f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:14.961672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814ffc-43fd-4f8d-9d3d-4679986f6f92 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:14.961953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814ffc-43fd-4f8d-9d3d-4679986f6f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:14.962227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da814ffc-43fd-4f8d-9d3d-4679986f6f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:14.963841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-da814ffc-43fd-4f8d-9d3d-4679986f6f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:15.070090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:15.074272 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da814ffc-43fd-4f8d-9d3d-4679986f6f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:15.075715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da814ffc-43fd-4f8d-9d3d-4679986f6f92 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:15.093477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 674/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:19.959268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694ee61-9fa0-4881-9d5d-fa2bf12ae929 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:19.959268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694ee61-9fa0-4881-9d5d-fa2bf12ae929 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:19.959268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694ee61-9fa0-4881-9d5d-fa2bf12ae929 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:19.961187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 676/1350] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:19.967548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25067-8a25-44a7-97ad-0d098f984fd5 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:19.967548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25067-8a25-44a7-97ad-0d098f984fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:19.967548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d25067-8a25-44a7-97ad-0d098f984fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:20.071929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c1d25067-8a25-44a7-97ad-0d098f984fd5 None None] MFA Rules not processed for user `99ee78db03794fbcb572ca1e98f231fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:20.073349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c1d25067-8a25-44a7-97ad-0d098f984fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:20.244908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 675/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:35:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:24.480247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf56b-0fc2-4800-afaf-e3798a5c46cc None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:24.480848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf56b-0fc2-4800-afaf-e3798a5c46cc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:24.480848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cf56b-0fc2-4800-afaf-e3798a5c46cc None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:24.482408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 677/1352] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:24.486678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=59 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:24.487714 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61495-baee-4ba7-9cf4-964801901eae None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:24.488219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61495-baee-4ba7-9cf4-964801901eae None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:24.488301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61495-baee-4ba7-9cf4-964801901eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:24.552156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:24.576715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7df61495-baee-4ba7-9cf4-964801901eae None None] MFA Rules not processed for user `99ee78db03794fbcb572ca1e98f231fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:24.577939 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7df61495-baee-4ba7-9cf4-964801901eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:24.691459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 676/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:35:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:26.121515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821085-7e1e-44a4-848c-af94729b1c94 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:26.122110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821085-7e1e-44a4-848c-af94729b1c94 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:26.122110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821085-7e1e-44a4-848c-af94729b1c94 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:26.123381 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 678/1354] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:26.128271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f2986-425c-497d-b566-e21d7f5af34e None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:26.128686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f2986-425c-497d-b566-e21d7f5af34e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:26.128840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f2986-425c-497d-b566-e21d7f5af34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:26.206262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-930f2986-425c-497d-b566-e21d7f5af34e None None] MFA Rules not processed for user `99ee78db03794fbcb572ca1e98f231fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:26.207427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-930f2986-425c-497d-b566-e21d7f5af34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:26.250926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:26.315381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 677/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:35:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:35:29.596501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd460b-308c-4006-82d9-ccb8de300180 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:29.597365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd460b-308c-4006-82d9-ccb8de300180 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:29.597808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd460b-308c-4006-82d9-ccb8de300180 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:29.600128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 679/1356] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:29.605479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd226d3-928c-4c48-858c-e7fb6b672d9d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:29.605911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd226d3-928c-4c48-858c-e7fb6b672d9d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:29.606028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd226d3-928c-4c48-858c-e7fb6b672d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:29.696347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-2bd226d3-928c-4c48-858c-e7fb6b672d9d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:29.698421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2bd226d3-928c-4c48-858c-e7fb6b672d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:29.820291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 678/1357] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:30.125771 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e1a84-983c-4c2d-af71-fd02e8907d55 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:30.126240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e1a84-983c-4c2d-af71-fd02e8907d55 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:30.126668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e1a84-983c-4c2d-af71-fd02e8907d55 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:30.128722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 680/1358] 10.222.0.55 () {54 vars in 962 bytes} [Thu Sep 1 15:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:30.137916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27ec2-8d38-457a-95c4-d518399ab2a7 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:30.138603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27ec2-8d38-457a-95c4-d518399ab2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:30.139411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe27ec2-8d38-457a-95c4-d518399ab2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:30.163971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:30.231446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-6fe27ec2-8d38-457a-95c4-d518399ab2a7 None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:30.232676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6fe27ec2-8d38-457a-95c4-d518399ab2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:30.369180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 679/1359] 10.222.0.55 () {58 vars in 1059 bytes} [Thu Sep 1 15:35:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:35:30.377048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e1a84-983c-4c2d-af71-fd02e8907d55 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:30.378702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-276e1a84-983c-4c2d-af71-fd02e8907d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:30.532732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e1a84-983c-4c2d-af71-fd02e8907d55 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:30.609636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:30.652698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3651b14-becd-4bbc-8e82-cb368ac52b84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:30.653458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3651b14-becd-4bbc-8e82-cb368ac52b84 service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:30.653778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3651b14-becd-4bbc-8e82-cb368ac52b84 service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:30.654002 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3651b14-becd-4bbc-8e82-cb368ac52b84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:30.656464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b3651b14-becd-4bbc-8e82-cb368ac52b84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:30.749623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3651b14-becd-4bbc-8e82-cb368ac52b84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:30.751824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3651b14-becd-4bbc-8e82-cb368ac52b84 service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:30.772575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 681/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:32.918797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1a624-2080-4ba2-8dd9-6f2f33f8de89 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:32.919301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1a624-2080-4ba2-8dd9-6f2f33f8de89 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:32.919301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1a624-2080-4ba2-8dd9-6f2f33f8de89 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:32.920807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 680/1361] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:32.925774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c3ed-630c-4412-94ee-a518cf1d7274 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:32.926691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c3ed-630c-4412-94ee-a518cf1d7274 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:32.926847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7c3ed-630c-4412-94ee-a518cf1d7274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:32.999123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-aed7c3ed-630c-4412-94ee-a518cf1d7274 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:33.000380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-aed7c3ed-630c-4412-94ee-a518cf1d7274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:33.040433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:33.106361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 682/1362] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:33.398932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1a624-2080-4ba2-8dd9-6f2f33f8de89 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:33.398932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b1e1a624-2080-4ba2-8dd9-6f2f33f8de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:33.477331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:33.566247 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1a624-2080-4ba2-8dd9-6f2f33f8de89 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:33.689059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca8df-5937-496a-bc88-3dd27188a0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:33.689673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca8df-5937-496a-bc88-3dd27188a0c0 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:33.689951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca8df-5937-496a-bc88-3dd27188a0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:33.690341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca8df-5937-496a-bc88-3dd27188a0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:33.692276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-639ca8df-5937-496a-bc88-3dd27188a0c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:33.718658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:33.796988 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ca8df-5937-496a-bc88-3dd27188a0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:33.798774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ca8df-5937-496a-bc88-3dd27188a0c0 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:33.818953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 681/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:36.053922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba973bf-4604-4c22-992f-d3be43f0f4c0 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:36.054451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba973bf-4604-4c22-992f-d3be43f0f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:36.054545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba973bf-4604-4c22-992f-d3be43f0f4c0 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:36.056746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 683/1364] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:36.062850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021e879-a91b-4c8e-8651-6704f610254c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:36.063314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021e879-a91b-4c8e-8651-6704f610254c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:36.063419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021e879-a91b-4c8e-8651-6704f610254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:36.134619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-1021e879-a91b-4c8e-8651-6704f610254c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:36.135898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1021e879-a91b-4c8e-8651-6704f610254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:36.236334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:36.239832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 682/1365] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:36.532788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1af7-3760-47ed-97c3-d0ece876d980 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:36.533082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1af7-3760-47ed-97c3-d0ece876d980 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:36.537374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1af7-3760-47ed-97c3-d0ece876d980 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:36.539723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 684/1366] 10.222.0.55 () {54 vars in 962 bytes} [Thu Sep 1 15:35:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:36.547623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8e92-0c61-4401-a101-90ed01123bac None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:36.548059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8e92-0c61-4401-a101-90ed01123bac None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:36.548434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8e92-0c61-4401-a101-90ed01123bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:36.627936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-cccb8e92-0c61-4401-a101-90ed01123bac None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:36.630313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-cccb8e92-0c61-4401-a101-90ed01123bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:36.753056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 683/1367] 10.222.0.55 () {58 vars in 1059 bytes} [Thu Sep 1 15:35:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:36.761595 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa1af7-3760-47ed-97c3-d0ece876d980 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:36.763197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d7aa1af7-3760-47ed-97c3-d0ece876d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:36.918508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa1af7-3760-47ed-97c3-d0ece876d980 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:36.949272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:37.055123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a45a-bd7b-4cf2-a28b-2497cde9d9b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:37.055798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a45a-bd7b-4cf2-a28b-2497cde9d9b6 service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:37.056070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a45a-bd7b-4cf2-a28b-2497cde9d9b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:37.056301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a45a-bd7b-4cf2-a28b-2497cde9d9b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:37.057929 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5a29a45a-bd7b-4cf2-a28b-2497cde9d9b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:37.149844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a45a-bd7b-4cf2-a28b-2497cde9d9b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:37.151448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a45a-bd7b-4cf2-a28b-2497cde9d9b6 service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:37.170141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 685/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:37.812530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3879c8-bc53-4e02-b300-472900b1d8d0 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:37.813076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3879c8-bc53-4e02-b300-472900b1d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:37.813076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3879c8-bc53-4e02-b300-472900b1d8d0 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:37.814620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 684/1369] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:37.820300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda8b0-baa2-4195-9dc1-e2d04d4cc82a None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:37.820593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda8b0-baa2-4195-9dc1-e2d04d4cc82a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:37.820873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda8b0-baa2-4195-9dc1-e2d04d4cc82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:37.855165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:37.892703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3beda8b0-baa2-4195-9dc1-e2d04d4cc82a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:37.894021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3beda8b0-baa2-4195-9dc1-e2d04d4cc82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:38.003299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 686/1370] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:38.586757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b225c-c196-44a7-87d1-e0d0c7ef12f9 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:38.587047 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b225c-c196-44a7-87d1-e0d0c7ef12f9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:38.587333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b225c-c196-44a7-87d1-e0d0c7ef12f9 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:38.589023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 685/1371] 10.222.0.55 () {54 vars in 964 bytes} [Thu Sep 1 15:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:38.593879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950d30-3d1b-44bd-a062-cd5b3788ae9a None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:38.594417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950d30-3d1b-44bd-a062-cd5b3788ae9a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:38.594417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950d30-3d1b-44bd-a062-cd5b3788ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:38.678125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b6950d30-3d1b-44bd-a062-cd5b3788ae9a None None] MFA Rules not processed for user `a9abba87fe6b44e5850d79dbd8d52469`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:38.679535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b6950d30-3d1b-44bd-a062-cd5b3788ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:38.727968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:38.761502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 687/1372] 10.222.0.55 () {58 vars in 1061 bytes} [Thu Sep 1 15:35:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:38.768953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b225c-c196-44a7-87d1-e0d0c7ef12f9 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:38.770478 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1b1b225c-c196-44a7-87d1-e0d0c7ef12f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:38.826050 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:38.882211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b225c-c196-44a7-87d1-e0d0c7ef12f9 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:38.969405 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f9fea-0ddf-4099-9c35-8d13e6d03bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:38.970021 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9fea-0ddf-4099-9c35-8d13e6d03bcc service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:38.970337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9fea-0ddf-4099-9c35-8d13e6d03bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:38.970564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9fea-0ddf-4099-9c35-8d13e6d03bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:38.972236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ea8f9fea-0ddf-4099-9c35-8d13e6d03bcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:39.072274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:39.089455 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f9fea-0ddf-4099-9c35-8d13e6d03bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:39.091246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f9fea-0ddf-4099-9c35-8d13e6d03bcc service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:39.114335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 686/1373] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:39.121405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3833-8a2d-45fa-b434-cf15f24d7aa9 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:39.121696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3833-8a2d-45fa-b434-cf15f24d7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:39.121977 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3833-8a2d-45fa-b434-cf15f24d7aa9 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:39.123337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 688/1374] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:39.128529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f5caf-d4d5-46e5-8767-5edfca4d3c19 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:39.128855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f5caf-d4d5-46e5-8767-5edfca4d3c19 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:39.129137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f5caf-d4d5-46e5-8767-5edfca4d3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:39.199941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-ac4f5caf-d4d5-46e5-8767-5edfca4d3c19 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:39.201200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ac4f5caf-d4d5-46e5-8767-5edfca4d3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:39.304221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 687/1375] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:39.595332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb3833-8a2d-45fa-b434-cf15f24d7aa9 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:39.597018 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-0bfb3833-8a2d-45fa-b434-cf15f24d7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:39.744827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb3833-8a2d-45fa-b434-cf15f24d7aa9 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:39.797120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:39.861500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894a76f-698a-4dbc-9882-1dc9e4b963b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:39.862106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a76f-698a-4dbc-9882-1dc9e4b963b6 service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:39.862389 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a76f-698a-4dbc-9882-1dc9e4b963b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:39.862661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a76f-698a-4dbc-9882-1dc9e4b963b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:39.864761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d894a76f-698a-4dbc-9882-1dc9e4b963b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:39.957479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894a76f-698a-4dbc-9882-1dc9e4b963b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:39.958580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894a76f-698a-4dbc-9882-1dc9e4b963b6 service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:39.978165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 689/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:41.919346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eda21e-c178-4f59-a8c3-e5f3fddbd02b None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:41.919867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eda21e-c178-4f59-a8c3-e5f3fddbd02b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:41.919867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eda21e-c178-4f59-a8c3-e5f3fddbd02b None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:41.921433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 688/1377] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:41.926554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f3097-1808-4a19-88f2-f9743afa34bf None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:41.926981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f3097-1808-4a19-88f2-f9743afa34bf None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:41.927221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f3097-1808-4a19-88f2-f9743afa34bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:42.005979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-d57f3097-1808-4a19-88f2-f9743afa34bf None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:42.007194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d57f3097-1808-4a19-88f2-f9743afa34bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:42.014183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:42.126369 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 690/1378] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:42.418740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eda21e-c178-4f59-a8c3-e5f3fddbd02b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:42.420294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f2eda21e-c178-4f59-a8c3-e5f3fddbd02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:42.481015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:42.588892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eda21e-c178-4f59-a8c3-e5f3fddbd02b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:42.736152 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5af510-61db-460d-93f8-7edf7e87f476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:42.736881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5af510-61db-460d-93f8-7edf7e87f476 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:42.737508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5af510-61db-460d-93f8-7edf7e87f476 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:42.738391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5af510-61db-460d-93f8-7edf7e87f476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:42.740109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1e5af510-61db-460d-93f8-7edf7e87f476 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:42.760063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:42.836155 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5af510-61db-460d-93f8-7edf7e87f476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:42.837756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5af510-61db-460d-93f8-7edf7e87f476 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:42.861004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 689/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:44.802884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c5f0-388b-414a-8b78-7eead99fb5d4 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:44.803416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c5f0-388b-414a-8b78-7eead99fb5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:44.803499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c5f0-388b-414a-8b78-7eead99fb5d4 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:44.805408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 691/1380] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:44.810675 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d5ee9-a167-4b27-8550-8f5c5d25c06e None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:44.811161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d5ee9-a167-4b27-8550-8f5c5d25c06e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:44.811265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d5ee9-a167-4b27-8550-8f5c5d25c06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:44.880081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-8f0d5ee9-a167-4b27-8550-8f5c5d25c06e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:44.881254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-8f0d5ee9-a167-4b27-8550-8f5c5d25c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:44.987296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:44.996947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 690/1381] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:45.282489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647c5f0-388b-414a-8b78-7eead99fb5d4 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:45.284176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2647c5f0-388b-414a-8b78-7eead99fb5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:45.434742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:45.447668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647c5f0-388b-414a-8b78-7eead99fb5d4 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:45.577086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b5ca8-b1c9-46d0-b518-8afd738a3da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:45.577613 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b5ca8-b1c9-46d0-b518-8afd738a3da0 service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:45.577898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b5ca8-b1c9-46d0-b518-8afd738a3da0 service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:45.578171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b5ca8-b1c9-46d0-b518-8afd738a3da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:45.579791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c20b5ca8-b1c9-46d0-b518-8afd738a3da0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:45.675062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b5ca8-b1c9-46d0-b518-8afd738a3da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:45.676898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b5ca8-b1c9-46d0-b518-8afd738a3da0 service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:45.688290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:45.703959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 692/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:47.650155 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e5e4-5d12-4754-b705-65077c7f2042 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:47.650962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e5e4-5d12-4754-b705-65077c7f2042 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:47.650962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e5e4-5d12-4754-b705-65077c7f2042 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:47.652197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 691/1383] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:47.657918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d545-4bda-484b-a81e-2281c63efb48 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:47.658330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d545-4bda-484b-a81e-2281c63efb48 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:47.658481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2d545-4bda-484b-a81e-2281c63efb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:47.738798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-8af2d545-4bda-484b-a81e-2281c63efb48 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:47.740053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8af2d545-4bda-484b-a81e-2281c63efb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:47.837733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 693/1384] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:48.140133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e5e4-5d12-4754-b705-65077c7f2042 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:48.142872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bed5e5e4-5d12-4754-b705-65077c7f2042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:48.314013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e5e4-5d12-4754-b705-65077c7f2042 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:48.385693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:48.434651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ed93e-57d1-4f2e-8ecb-b4cb8119ed71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:48.435256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ed93e-57d1-4f2e-8ecb-b4cb8119ed71 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:48.435586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ed93e-57d1-4f2e-8ecb-b4cb8119ed71 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:48.435836 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ed93e-57d1-4f2e-8ecb-b4cb8119ed71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:48.437446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f79ed93e-57d1-4f2e-8ecb-b4cb8119ed71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:48.528701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ed93e-57d1-4f2e-8ecb-b4cb8119ed71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:48.530411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ed93e-57d1-4f2e-8ecb-b4cb8119ed71 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:48.553629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 692/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:50.438926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646992c-f15f-4aaa-9c90-31492c56e5cd None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:50.439754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646992c-f15f-4aaa-9c90-31492c56e5cd None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:50.439754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646992c-f15f-4aaa-9c90-31492c56e5cd None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:50.440977 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 694/1386] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:50.446782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a3d15-296d-4a01-bd24-e306cacc0593 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:50.447210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a3d15-296d-4a01-bd24-e306cacc0593 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:50.447362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a3d15-296d-4a01-bd24-e306cacc0593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:50.522772 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-994a3d15-296d-4a01-bd24-e306cacc0593 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:50.524071 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-994a3d15-296d-4a01-bd24-e306cacc0593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:50.560225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:50.638285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 693/1387] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:50.950139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646992c-f15f-4aaa-9c90-31492c56e5cd None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:50.951801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2646992c-f15f-4aaa-9c90-31492c56e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:51.043609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:51.133911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646992c-f15f-4aaa-9c90-31492c56e5cd None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:51.275043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cd9ef-0ad9-4473-b922-2c63f45e1362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:51.275793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd9ef-0ad9-4473-b922-2c63f45e1362 service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:51.276159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd9ef-0ad9-4473-b922-2c63f45e1362 service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:51.276497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cd9ef-0ad9-4473-b922-2c63f45e1362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:51.278573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-035cd9ef-0ad9-4473-b922-2c63f45e1362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:51.322462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:51.379639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cd9ef-0ad9-4473-b922-2c63f45e1362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:51.381283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cd9ef-0ad9-4473-b922-2c63f45e1362 service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:51.400539 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 695/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:53.341960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a078082-27c7-40f5-b6b1-6fb0e8e91dc4 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:53.342489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a078082-27c7-40f5-b6b1-6fb0e8e91dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:53.342489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a078082-27c7-40f5-b6b1-6fb0e8e91dc4 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:53.343854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 694/1389] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:53.349197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58009f-2db3-4600-a8e6-433610386f30 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:53.349678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58009f-2db3-4600-a8e6-433610386f30 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:53.349778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58009f-2db3-4600-a8e6-433610386f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:53.420003 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3f58009f-2db3-4600-a8e6-433610386f30 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:53.421188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3f58009f-2db3-4600-a8e6-433610386f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:53.518340 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 696/1390] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:53.804881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a078082-27c7-40f5-b6b1-6fb0e8e91dc4 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:53.806441 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6a078082-27c7-40f5-b6b1-6fb0e8e91dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:53.960071 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a078082-27c7-40f5-b6b1-6fb0e8e91dc4 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:53.977235 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:54.076695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4168a1-cb6a-4f9a-9313-b6357ebf1dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:54.077308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4168a1-cb6a-4f9a-9313-b6357ebf1dda service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:54.077589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4168a1-cb6a-4f9a-9313-b6357ebf1dda service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:54.077869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4168a1-cb6a-4f9a-9313-b6357ebf1dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:54.079480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ae4168a1-cb6a-4f9a-9313-b6357ebf1dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:54.089161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddc03-1057-4452-a349-63718b03624c None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:54.089448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddc03-1057-4452-a349-63718b03624c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:54.089725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bddc03-1057-4452-a349-63718b03624c None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:54.091081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 697/1391] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:35:54.096073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a269e-6e64-47b1-9023-d50df0150cd8 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:54.096986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a269e-6e64-47b1-9023-d50df0150cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:54.097279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a269e-6e64-47b1-9023-d50df0150cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:54.112421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:54.164298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-fa3a269e-6e64-47b1-9023-d50df0150cd8 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:54.165503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-fa3a269e-6e64-47b1-9023-d50df0150cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:54.173878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4168a1-cb6a-4f9a-9313-b6357ebf1dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:54.175551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4168a1-cb6a-4f9a-9313-b6357ebf1dda service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:54.193897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 695/1392] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:54.266992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 698/1393] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:35:54.566004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fcd4a-20a3-49fa-9ac2-80a89b47249b None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:54.566493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fcd4a-20a3-49fa-9ac2-80a89b47249b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:54.566591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fcd4a-20a3-49fa-9ac2-80a89b47249b None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:54.568028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 696/1394] 10.222.0.55 () {54 vars in 967 bytes} [Thu Sep 1 15:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:54.573250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21d9cf-c6d1-45ea-aad5-0dbce2d9d8d1 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:54.573644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21d9cf-c6d1-45ea-aad5-0dbce2d9d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:54.573802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21d9cf-c6d1-45ea-aad5-0dbce2d9d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:54.652148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6d21d9cf-c6d1-45ea-aad5-0dbce2d9d8d1 None None] MFA Rules not processed for user `df1a3f053649456d982dd6c2d45d23c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:54.653358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6d21d9cf-c6d1-45ea-aad5-0dbce2d9d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:54.688871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:54.731648 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 699/1395] 10.222.0.55 () {58 vars in 1064 bytes} [Thu Sep 1 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:54.739643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fcd4a-20a3-49fa-9ac2-80a89b47249b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:54.741199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-fe8fcd4a-20a3-49fa-9ac2-80a89b47249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:54.764976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:54.846678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fcd4a-20a3-49fa-9ac2-80a89b47249b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:54.919793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622b758-6e67-44b2-8a91-a57eb742d072 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df1a3f053649456d982dd6c2d45d23c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:54.920408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b758-6e67-44b2-8a91-a57eb742d072 service glance] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:54.920690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b758-6e67-44b2-8a91-a57eb742d072 service glance] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:54.920968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b758-6e67-44b2-8a91-a57eb742d072 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:54.922569 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7622b758-6e67-44b2-8a91-a57eb742d072 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:55.001911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:55.038957 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622b758-6e67-44b2-8a91-a57eb742d072 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:55.040527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622b758-6e67-44b2-8a91-a57eb742d072 service glance] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:55.059374 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 697/1396] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:55.792141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a062-639c-4924-8d4a-aa8e01f5e5df None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:55.792624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a062-639c-4924-8d4a-aa8e01f5e5df None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:55.792707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a062-639c-4924-8d4a-aa8e01f5e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:55.860790 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-76e0a062-639c-4924-8d4a-aa8e01f5e5df None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:55.862022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-76e0a062-639c-4924-8d4a-aa8e01f5e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:55.954220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 700/1397] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:55.996060 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5e58-e8dd-4872-b9fd-aaa0eb2d2159 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:55.996968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5e58-e8dd-4872-b9fd-aaa0eb2d2159 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:55.996968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5e58-e8dd-4872-b9fd-aaa0eb2d2159 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:56.000154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 698/1398] 10.222.0.55 () {54 vars in 943 bytes} [Thu Sep 1 15:35:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:56.009480 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6710d-bcaa-406f-a10e-6fd57c232cf5 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:56.009738 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6710d-bcaa-406f-a10e-6fd57c232cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:56.010002 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6710d-bcaa-406f-a10e-6fd57c232cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:56.070331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:56.089645 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-17b6710d-bcaa-406f-a10e-6fd57c232cf5 None None] MFA Rules not processed for user `d0df2e3dd45c43c5a6f10c28479732b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:56.090844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-17b6710d-bcaa-406f-a10e-6fd57c232cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:56.173212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e53ef8-ef38-4920-92ce-6338ab5169cd None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:56.173496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e53ef8-ef38-4920-92ce-6338ab5169cd None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:56.173777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e53ef8-ef38-4920-92ce-6338ab5169cd None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:56.175814 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 699/1399] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:35:56.180619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad688b-045b-41fe-8f1f-eb7d6a705e43 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:56.180905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad688b-045b-41fe-8f1f-eb7d6a705e43 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:56.181184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad688b-045b-41fe-8f1f-eb7d6a705e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:56.196651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 701/1400] 10.222.0.55 () {58 vars in 1040 bytes} [Thu Sep 1 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:56.205860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6710d-bcaa-406f-a10e-6fd57c232cf5 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:56.215014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6710d-bcaa-406f-a10e-6fd57c232cf5 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:56.248604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-90ad688b-045b-41fe-8f1f-eb7d6a705e43 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:56.249809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-90ad688b-045b-41fe-8f1f-eb7d6a705e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:56.314659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:56.321829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8c3b7-9302-4dac-be50-740b1ec3aaf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:56.322377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c3b7-9302-4dac-be50-740b1ec3aaf5 service swift] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:56.322660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c3b7-9302-4dac-be50-740b1ec3aaf5 service swift] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:56.322933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8c3b7-9302-4dac-be50-740b1ec3aaf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:56.324763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-02e8c3b7-9302-4dac-be50-740b1ec3aaf5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:56.350343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 700/1401] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:35:56.406617 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8c3b7-9302-4dac-be50-740b1ec3aaf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:56.408241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8c3b7-9302-4dac-be50-740b1ec3aaf5 service swift] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:56.416047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 702/1402] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:35:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 15:35:56.643514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad688b-045b-41fe-8f1f-eb7d6a705e43 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:56.644786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-90ad688b-045b-41fe-8f1f-eb7d6a705e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:56.682856 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:56.771146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad688b-045b-41fe-8f1f-eb7d6a705e43 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:56.901378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ff4e-9e85-4eef-875f-155cfde9de01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:56.902167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ff4e-9e85-4eef-875f-155cfde9de01 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:56.902547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ff4e-9e85-4eef-875f-155cfde9de01 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:56.902920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ff4e-9e85-4eef-875f-155cfde9de01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:56.904738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5364ff4e-9e85-4eef-875f-155cfde9de01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:56.936069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:57.012758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364ff4e-9e85-4eef-875f-155cfde9de01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:57.014495 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364ff4e-9e85-4eef-875f-155cfde9de01 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:57.034232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 701/1403] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:35:59.048977 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cdf05-4db4-494e-84e6-3452e32cf902 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:59.049621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cdf05-4db4-494e-84e6-3452e32cf902 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:59.049621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cdf05-4db4-494e-84e6-3452e32cf902 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:59.050939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 703/1404] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:35:59.057594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c3b-c02e-4081-8ee7-05fc8ed7fe83 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:59.058165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c3b-c02e-4081-8ee7-05fc8ed7fe83 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:59.058165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba8c3b-c02e-4081-8ee7-05fc8ed7fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:59.140544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-dfba8c3b-c02e-4081-8ee7-05fc8ed7fe83 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:35:59.141795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-dfba8c3b-c02e-4081-8ee7-05fc8ed7fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:59.263661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 702/1405] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:35:59.565598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cdf05-4db4-494e-84e6-3452e32cf902 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:35:59.567121 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-162cdf05-4db4-494e-84e6-3452e32cf902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:59.730942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:59.744626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cdf05-4db4-494e-84e6-3452e32cf902 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:35:59.870024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e586de-45af-42f9-a8b2-d5072d70c5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:35:59.870906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e586de-45af-42f9-a8b2-d5072d70c5f3 service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:35:59.871364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e586de-45af-42f9-a8b2-d5072d70c5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:35:59.871859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e586de-45af-42f9-a8b2-d5072d70c5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:35:59.873484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-a3e586de-45af-42f9-a8b2-d5072d70c5f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:35:59.978309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e586de-45af-42f9-a8b2-d5072d70c5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:35:59.979994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e586de-45af-42f9-a8b2-d5072d70c5f3 service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:35:59.990383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:35:59.999465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 704/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:01.970113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efeb34-1750-4d7d-83a9-2ba0e31155b2 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:01.970650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efeb34-1750-4d7d-83a9-2ba0e31155b2 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:01.970650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efeb34-1750-4d7d-83a9-2ba0e31155b2 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:01.976087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 703/1407] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:36:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:01.977415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd30d9-9e42-4b56-b29f-7483ca1f61a8 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:01.977865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd30d9-9e42-4b56-b29f-7483ca1f61a8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:01.977976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd30d9-9e42-4b56-b29f-7483ca1f61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:02.055313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-d2bd30d9-9e42-4b56-b29f-7483ca1f61a8 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:02.056590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d2bd30d9-9e42-4b56-b29f-7483ca1f61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:02.171824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 705/1408] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:36:02.469111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efeb34-1750-4d7d-83a9-2ba0e31155b2 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:02.470639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-73efeb34-1750-4d7d-83a9-2ba0e31155b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:02.473749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:02.656332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efeb34-1750-4d7d-83a9-2ba0e31155b2 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:02.752284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:02.799452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4c4c6-9aca-42c4-950f-8cd78fc0e3b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:02.800104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4c4c6-9aca-42c4-950f-8cd78fc0e3b1 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:02.800388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4c4c6-9aca-42c4-950f-8cd78fc0e3b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:02.800658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4c4c6-9aca-42c4-950f-8cd78fc0e3b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:02.802278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-63b4c4c6-9aca-42c4-950f-8cd78fc0e3b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:02.902218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4c4c6-9aca-42c4-950f-8cd78fc0e3b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:02.903995 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4c4c6-9aca-42c4-950f-8cd78fc0e3b1 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:02.923113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 704/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:36:12.169070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=67 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:12.920514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=61 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:18.551110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00da5a-cd5d-4c6e-b69f-1b5362148b10 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:18.551681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00da5a-cd5d-4c6e-b69f-1b5362148b10 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:18.551681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00da5a-cd5d-4c6e-b69f-1b5362148b10 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:18.553088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 706/1410] 10.222.0.55 () {54 vars in 918 bytes} [Thu Sep 1 15:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:18.558257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1ae49-4d7c-4250-a13c-ed3b14250cfc None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:18.558725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1ae49-4d7c-4250-a13c-ed3b14250cfc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:18.558822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1ae49-4d7c-4250-a13c-ed3b14250cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:18.633446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-26e1ae49-4d7c-4250-a13c-ed3b14250cfc None None] MFA Rules not processed for user `99ee78db03794fbcb572ca1e98f231fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:18.634632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-26e1ae49-4d7c-4250-a13c-ed3b14250cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:18.738957 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 705/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Sep 1 15:36:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:18.753764 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120084ff-ccdd-4f04-8645-bd2658954c2f None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:18.754053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120084ff-ccdd-4f04-8645-bd2658954c2f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:18.754332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120084ff-ccdd-4f04-8645-bd2658954c2f None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:18.755665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 707/1412] 10.222.0.55 () {54 vars in 918 bytes} [Thu Sep 1 15:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:18.760554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158fd87-0fb8-4abf-90ce-7d0f254aa312 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:18.760843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158fd87-0fb8-4abf-90ce-7d0f254aa312 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:18.761118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158fd87-0fb8-4abf-90ce-7d0f254aa312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:18.833796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:18.836937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c158fd87-0fb8-4abf-90ce-7d0f254aa312 None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:18.838512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c158fd87-0fb8-4abf-90ce-7d0f254aa312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:18.954640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 706/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Sep 1 15:36:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:21.327329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fb8d-8f27-429a-a24e-a2e581b667cc None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:21.327934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fb8d-8f27-429a-a24e-a2e581b667cc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:21.327934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81fb8d-8f27-429a-a24e-a2e581b667cc None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:21.329868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:21.335234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc7b1-2781-47b9-869f-d59246b9c864 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:21.335698 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc7b1-2781-47b9-869f-d59246b9c864 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:21.335841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc7b1-2781-47b9-869f-d59246b9c864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:21.400998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-0b3bc7b1-2781-47b9-869f-d59246b9c864 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:21.402189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0b3bc7b1-2781-47b9-869f-d59246b9c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:21.456102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:21.496693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:21.787412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81fb8d-8f27-429a-a24e-a2e581b667cc None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:21.789162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-cd81fb8d-8f27-429a-a24e-a2e581b667cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:21.942331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81fb8d-8f27-429a-a24e-a2e581b667cc None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:22.017821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:22.072276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895ff25-2fb6-4707-ae16-55ce74db263b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:22.072827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ff25-2fb6-4707-ae16-55ce74db263b service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:22.073107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ff25-2fb6-4707-ae16-55ce74db263b service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:22.073375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ff25-2fb6-4707-ae16-55ce74db263b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:22.075228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4895ff25-2fb6-4707-ae16-55ce74db263b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:22.165445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895ff25-2fb6-4707-ae16-55ce74db263b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:22.167066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895ff25-2fb6-4707-ae16-55ce74db263b service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:22.185206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 709/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:23.068983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1d53-e2b8-4f47-af4d-a1506a729673 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:23.069567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1d53-e2b8-4f47-af4d-a1506a729673 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:23.069567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1d53-e2b8-4f47-af4d-a1506a729673 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:23.070890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:23.075868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e2e63-4ea7-4eb2-b20f-e6220eaaeea5 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:23.076272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e2e63-4ea7-4eb2-b20f-e6220eaaeea5 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:23.076424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e2e63-4ea7-4eb2-b20f-e6220eaaeea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:23.152566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f58e2e63-4ea7-4eb2-b20f-e6220eaaeea5 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:23.153771 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f58e2e63-4ea7-4eb2-b20f-e6220eaaeea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:23.182099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:23.250960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:23.400739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e1d53-e2b8-4f47-af4d-a1506a729673 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:23.402309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f49e1d53-e2b8-4f47-af4d-a1506a729673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:23.546958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e1d53-e2b8-4f47-af4d-a1506a729673 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:23.587081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:23.661021 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c432256-bdcc-4b45-89f9-c226349e841f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:23.661625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432256-bdcc-4b45-89f9-c226349e841f service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:23.661907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432256-bdcc-4b45-89f9-c226349e841f service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:23.662185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c432256-bdcc-4b45-89f9-c226349e841f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:23.663809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1c432256-bdcc-4b45-89f9-c226349e841f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:23.751731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c432256-bdcc-4b45-89f9-c226349e841f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:23.753372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c432256-bdcc-4b45-89f9-c226349e841f service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:23.771924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 709/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:24.643935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8df0-46b1-4a25-b55b-c26357979a59 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:24.644511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8df0-46b1-4a25-b55b-c26357979a59 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:24.644511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e8df0-46b1-4a25-b55b-c26357979a59 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:24.645844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:24.650730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49c486-915c-43bd-ad7b-2e78f98a54fe None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:24.651138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49c486-915c-43bd-ad7b-2e78f98a54fe None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:24.651261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49c486-915c-43bd-ad7b-2e78f98a54fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:24.705253 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:24.727230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-2d49c486-915c-43bd-ad7b-2e78f98a54fe None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:24.728473 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2d49c486-915c-43bd-ad7b-2e78f98a54fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:24.825181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:24.973624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8df0-46b1-4a25-b55b-c26357979a59 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:24.975405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-763e8df0-46b1-4a25-b55b-c26357979a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:25.118095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e8df0-46b1-4a25-b55b-c26357979a59 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:25.130119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:25.230742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa6683-afb1-4623-9d3c-2b1b5295b27f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:25.231270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6683-afb1-4623-9d3c-2b1b5295b27f service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:25.231554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6683-afb1-4623-9d3c-2b1b5295b27f service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:25.231857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6683-afb1-4623-9d3c-2b1b5295b27f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:25.233457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-94fa6683-afb1-4623-9d3c-2b1b5295b27f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:25.320309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa6683-afb1-4623-9d3c-2b1b5295b27f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:25.321925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa6683-afb1-4623-9d3c-2b1b5295b27f service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:25.339277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 712/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:26.204272 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaa98d-2bec-4019-9619-70ec708dbea8 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:26.204825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaa98d-2bec-4019-9619-70ec708dbea8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:26.204825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaa98d-2bec-4019-9619-70ec708dbea8 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:26.206185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:26.211083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024275-a16c-4056-8e30-0d1bede870fb None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:26.211492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024275-a16c-4056-8e30-0d1bede870fb None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:26.211627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024275-a16c-4056-8e30-0d1bede870fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:26.230920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:26.287235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ac024275-a16c-4056-8e30-0d1bede870fb None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:26.288459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ac024275-a16c-4056-8e30-0d1bede870fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:26.383296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:36:26.560261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaa98d-2bec-4019-9619-70ec708dbea8 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:26.561915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-8bcaa98d-2bec-4019-9619-70ec708dbea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:26.675807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:26.711748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaa98d-2bec-4019-9619-70ec708dbea8 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:26.824724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bc2f6-4abb-4d02-8003-c7610763cbba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:26.825272 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bc2f6-4abb-4d02-8003-c7610763cbba service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:26.825552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bc2f6-4abb-4d02-8003-c7610763cbba service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:26.825826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bc2f6-4abb-4d02-8003-c7610763cbba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:26.827421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-197bc2f6-4abb-4d02-8003-c7610763cbba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:26.902560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:26.916801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bc2f6-4abb-4d02-8003-c7610763cbba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:26.918400 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bc2f6-4abb-4d02-8003-c7610763cbba service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:26.935869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 712/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:27.794227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc714-ea80-4d53-b721-5afe7d1129b9 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:27.794768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc714-ea80-4d53-b721-5afe7d1129b9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:27.794768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc714-ea80-4d53-b721-5afe7d1129b9 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:27.796162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:27.801185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676546c8-a328-4705-a541-cc09d53b6dce None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:27.801625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676546c8-a328-4705-a541-cc09d53b6dce None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:27.801737 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676546c8-a328-4705-a541-cc09d53b6dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:27.875354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-676546c8-a328-4705-a541-cc09d53b6dce None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:27.876555 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-676546c8-a328-4705-a541-cc09d53b6dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:27.972961 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:28.122205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc714-ea80-4d53-b721-5afe7d1129b9 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:28.123765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7e4cc714-ea80-4d53-b721-5afe7d1129b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:28.207136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:28.275571 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc714-ea80-4d53-b721-5afe7d1129b9 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:28.385881 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f512377-44c9-4d19-9f91-0af847733fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:28.386492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f512377-44c9-4d19-9f91-0af847733fcb service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:28.386773 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f512377-44c9-4d19-9f91-0af847733fcb service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:28.387056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f512377-44c9-4d19-9f91-0af847733fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:28.388701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9f512377-44c9-4d19-9f91-0af847733fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:28.437073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:28.477649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f512377-44c9-4d19-9f91-0af847733fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:28.479254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f512377-44c9-4d19-9f91-0af847733fcb service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:28.497221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 715/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:29.297999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b062293-2725-464b-9048-7920fb7c2f3c None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:29.298554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b062293-2725-464b-9048-7920fb7c2f3c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:29.298554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b062293-2725-464b-9048-7920fb7c2f3c None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:29.299906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:29.304683 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0d36-c53f-4466-916a-4b9f5c226605 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:29.305117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0d36-c53f-4466-916a-4b9f5c226605 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:29.305268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0d36-c53f-4466-916a-4b9f5c226605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:29.380134 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-edfb0d36-c53f-4466-916a-4b9f5c226605 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:29.381348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-edfb0d36-c53f-4466-916a-4b9f5c226605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:29.475645 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:29.624478 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b062293-2725-464b-9048-7920fb7c2f3c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:29.626501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-8b062293-2725-464b-9048-7920fb7c2f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:29.675122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:29.772126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b062293-2725-464b-9048-7920fb7c2f3c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:29.884523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015544-14fa-4d48-bf29-10c4310543b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:29.885058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015544-14fa-4d48-bf29-10c4310543b9 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:29.885340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015544-14fa-4d48-bf29-10c4310543b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:29.885612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015544-14fa-4d48-bf29-10c4310543b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:29.887213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-db015544-14fa-4d48-bf29-10c4310543b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:29.894748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:29.976115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db015544-14fa-4d48-bf29-10c4310543b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:29.977719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db015544-14fa-4d48-bf29-10c4310543b9 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:29.995739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 715/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:30.799169 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf039e1-713e-4f6d-ac33-b1206763b903 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:30.799742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf039e1-713e-4f6d-ac33-b1206763b903 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:30.799742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf039e1-713e-4f6d-ac33-b1206763b903 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:30.801145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:30.806176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04916-02da-4551-9fda-ebe53c4388eb None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:30.806637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04916-02da-4551-9fda-ebe53c4388eb None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:30.806753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04916-02da-4551-9fda-ebe53c4388eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:30.881372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-02d04916-02da-4551-9fda-ebe53c4388eb None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:30.882893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-02d04916-02da-4551-9fda-ebe53c4388eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:30.950414 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:30.980189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:36:31.136094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf039e1-713e-4f6d-ac33-b1206763b903 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:31.137622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2cf039e1-713e-4f6d-ac33-b1206763b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:31.154948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:31.281889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf039e1-713e-4f6d-ac33-b1206763b903 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:31.366851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:31.392931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90328ad6-02ca-442e-a7a3-42e4a372575d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:31.393548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90328ad6-02ca-442e-a7a3-42e4a372575d service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:31.393829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90328ad6-02ca-442e-a7a3-42e4a372575d service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:31.394099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90328ad6-02ca-442e-a7a3-42e4a372575d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:31.395695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-90328ad6-02ca-442e-a7a3-42e4a372575d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:31.483305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90328ad6-02ca-442e-a7a3-42e4a372575d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:31.484988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90328ad6-02ca-442e-a7a3-42e4a372575d service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:31.502750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 718/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:32.296624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230f1a-39e2-42d4-b06e-d845e69f0d41 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:32.297200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230f1a-39e2-42d4-b06e-d845e69f0d41 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:32.297200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63230f1a-39e2-42d4-b06e-d845e69f0d41 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:32.299062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:32.304084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67007ba-bc89-42e5-88c7-a9db95ed7bfc None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:32.304537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67007ba-bc89-42e5-88c7-a9db95ed7bfc None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:32.304642 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67007ba-bc89-42e5-88c7-a9db95ed7bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:32.379718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b67007ba-bc89-42e5-88c7-a9db95ed7bfc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:32.381006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b67007ba-bc89-42e5-88c7-a9db95ed7bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:32.421175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:32.475600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:32.625636 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63230f1a-39e2-42d4-b06e-d845e69f0d41 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:32.627167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-63230f1a-39e2-42d4-b06e-d845e69f0d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:32.776438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63230f1a-39e2-42d4-b06e-d845e69f0d41 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:32.829158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:32.889243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21317b-eff0-43ed-93b5-0158df0cd61f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:32.889791 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21317b-eff0-43ed-93b5-0158df0cd61f service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:32.890073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21317b-eff0-43ed-93b5-0158df0cd61f service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:32.890348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21317b-eff0-43ed-93b5-0158df0cd61f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:32.892477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7a21317b-eff0-43ed-93b5-0158df0cd61f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:32.981095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21317b-eff0-43ed-93b5-0158df0cd61f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:32.982697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21317b-eff0-43ed-93b5-0158df0cd61f service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:33.000365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 718/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:33.805479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c24e2-6b72-4af5-8bb4-09ad52ecdb33 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:33.805995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c24e2-6b72-4af5-8bb4-09ad52ecdb33 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:33.806121 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c24e2-6b72-4af5-8bb4-09ad52ecdb33 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:33.807390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:33.812187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd788577-3086-4893-b9a0-78ddfcef4c7d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:33.812635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd788577-3086-4893-b9a0-78ddfcef4c7d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:33.812735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd788577-3086-4893-b9a0-78ddfcef4c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:33.887726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-dd788577-3086-4893-b9a0-78ddfcef4c7d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:33.888957 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-dd788577-3086-4893-b9a0-78ddfcef4c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:33.890990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:33.987268 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:34.138328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c24e2-6b72-4af5-8bb4-09ad52ecdb33 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:34.139907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-575c24e2-6b72-4af5-8bb4-09ad52ecdb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:34.282473 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c24e2-6b72-4af5-8bb4-09ad52ecdb33 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:34.308145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:34.392717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57056a3-0fd6-466b-a3bc-d2ccb9a27f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:34.393322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57056a3-0fd6-466b-a3bc-d2ccb9a27f2d service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:34.393603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57056a3-0fd6-466b-a3bc-d2ccb9a27f2d service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:34.393876 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57056a3-0fd6-466b-a3bc-d2ccb9a27f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:34.395466 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e57056a3-0fd6-466b-a3bc-d2ccb9a27f2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:34.483227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57056a3-0fd6-466b-a3bc-d2ccb9a27f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:34.484884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57056a3-0fd6-466b-a3bc-d2ccb9a27f2d service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:34.504012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 721/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:36.313477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf746ef-3913-452f-846a-d9ae3576e005 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:36.314009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf746ef-3913-452f-846a-d9ae3576e005 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:36.314009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf746ef-3913-452f-846a-d9ae3576e005 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:36.315285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:36.320454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca610a-069f-4465-b9e6-405159046ec1 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:36.320911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca610a-069f-4465-b9e6-405159046ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:36.321011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca610a-069f-4465-b9e6-405159046ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:36.362776 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:36.504773 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-40ca610a-069f-4465-b9e6-405159046ec1 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:36.505983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-40ca610a-069f-4465-b9e6-405159046ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:36.599318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:36.881350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf746ef-3913-452f-846a-d9ae3576e005 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:36.883198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2cf746ef-3913-452f-846a-d9ae3576e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:36.985054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf746ef-3913-452f-846a-d9ae3576e005 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:37.017157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:37.058178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f8016-6fb6-4de3-ba73-ab5ce65161d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:37.058853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f8016-6fb6-4de3-ba73-ab5ce65161d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:37.059140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f8016-6fb6-4de3-ba73-ab5ce65161d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:37.059420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f8016-6fb6-4de3-ba73-ab5ce65161d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:37.061065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c84f8016-6fb6-4de3-ba73-ab5ce65161d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:37.170032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f8016-6fb6-4de3-ba73-ab5ce65161d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:37.171443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f8016-6fb6-4de3-ba73-ab5ce65161d3 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:37.189898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 721/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:39.244282 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0e8a-cc75-4f8b-af28-abedbb1720c8 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:39.244821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0e8a-cc75-4f8b-af28-abedbb1720c8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:39.244821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0e8a-cc75-4f8b-af28-abedbb1720c8 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:39.246082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:39.252022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3258b-93bc-41c0-872a-33f80f7969e0 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:39.252471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3258b-93bc-41c0-872a-33f80f7969e0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:39.252581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3258b-93bc-41c0-872a-33f80f7969e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:39.320378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-54d3258b-93bc-41c0-872a-33f80f7969e0 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:39.321591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-54d3258b-93bc-41c0-872a-33f80f7969e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:39.334192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:39.418267 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:39.701112 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb0e8a-cc75-4f8b-af28-abedbb1720c8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:39.702637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7dcb0e8a-cc75-4f8b-af28-abedbb1720c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:39.804952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb0e8a-cc75-4f8b-af28-abedbb1720c8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:39.817026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:39.877113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcec02-f3e2-4b7d-9762-c658da09fb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:39.877717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcec02-f3e2-4b7d-9762-c658da09fb32 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:39.877996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcec02-f3e2-4b7d-9762-c658da09fb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:39.878266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcec02-f3e2-4b7d-9762-c658da09fb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:39.879882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-68fcec02-f3e2-4b7d-9762-c658da09fb32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:39.987983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcec02-f3e2-4b7d-9762-c658da09fb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:39.989417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcec02-f3e2-4b7d-9762-c658da09fb32 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:40.006619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 724/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:42.205571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba356a56-8089-4fb3-b24b-a242824db8f8 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:42.206100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba356a56-8089-4fb3-b24b-a242824db8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:42.206100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba356a56-8089-4fb3-b24b-a242824db8f8 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:42.207509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:36:42.212828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f32c-59d1-4699-9539-5ed503e09d92 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:42.213238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f32c-59d1-4699-9539-5ed503e09d92 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:42.213378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f32c-59d1-4699-9539-5ed503e09d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:42.261477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:42.279664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-12c3f32c-59d1-4699-9539-5ed503e09d92 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:42.280888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-12c3f32c-59d1-4699-9539-5ed503e09d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:42.374261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:42.657634 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba356a56-8089-4fb3-b24b-a242824db8f8 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:42.659215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ba356a56-8089-4fb3-b24b-a242824db8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:42.761128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba356a56-8089-4fb3-b24b-a242824db8f8 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:42.800940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:42.835096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75912f-8862-42e1-8fd2-611d8b3ec478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:42.835708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75912f-8862-42e1-8fd2-611d8b3ec478 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:42.836019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75912f-8862-42e1-8fd2-611d8b3ec478 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:42.836312 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75912f-8862-42e1-8fd2-611d8b3ec478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:42.837890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7e75912f-8862-42e1-8fd2-611d8b3ec478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:42.945136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75912f-8862-42e1-8fd2-611d8b3ec478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:42.946562 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75912f-8862-42e1-8fd2-611d8b3ec478 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:42.966472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 724/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:44.975968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629dcac-f5b0-441e-8628-4bb45110b65e None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:44.976438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629dcac-f5b0-441e-8628-4bb45110b65e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:44.976534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629dcac-f5b0-441e-8628-4bb45110b65e None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:44.977857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:44.983056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a83540-d0ae-4ace-8f83-5b589700362d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:44.983445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a83540-d0ae-4ace-8f83-5b589700362d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:44.983603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a83540-d0ae-4ace-8f83-5b589700362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:45.050111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-34a83540-d0ae-4ace-8f83-5b589700362d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:45.051307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-34a83540-d0ae-4ace-8f83-5b589700362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:45.072082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:45.148579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:45.436789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629dcac-f5b0-441e-8628-4bb45110b65e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:45.438332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7629dcac-f5b0-441e-8628-4bb45110b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:45.540946 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629dcac-f5b0-441e-8628-4bb45110b65e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:45.561083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:45.614020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609b29c-72ef-4dff-bb52-5287ac7f106a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:45.614621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609b29c-72ef-4dff-bb52-5287ac7f106a service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:45.614901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609b29c-72ef-4dff-bb52-5287ac7f106a service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:45.615174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609b29c-72ef-4dff-bb52-5287ac7f106a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:45.616807 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7609b29c-72ef-4dff-bb52-5287ac7f106a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:45.735303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609b29c-72ef-4dff-bb52-5287ac7f106a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:45.737343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609b29c-72ef-4dff-bb52-5287ac7f106a service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:45.755945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 727/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:47.711079 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80bea3-f583-4be9-8117-309994c0ddc8 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:47.711624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80bea3-f583-4be9-8117-309994c0ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:47.711624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80bea3-f583-4be9-8117-309994c0ddc8 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:47.713051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:47.718336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6faf7c-0660-48c7-b7e5-4f8542c02dfe None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:47.718774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6faf7c-0660-48c7-b7e5-4f8542c02dfe None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:47.718871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6faf7c-0660-48c7-b7e5-4f8542c02dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:47.782481 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:47.786512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-7c6faf7c-0660-48c7-b7e5-4f8542c02dfe None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:47.788364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7c6faf7c-0660-48c7-b7e5-4f8542c02dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:47.882209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:48.178293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80bea3-f583-4be9-8117-309994c0ddc8 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:48.179915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7a80bea3-f583-4be9-8117-309994c0ddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:48.281984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80bea3-f583-4be9-8117-309994c0ddc8 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:48.330144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:48.354693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188631a4-abaf-464c-94f3-740c008e2e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:48.355304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188631a4-abaf-464c-94f3-740c008e2e69 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:48.355585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188631a4-abaf-464c-94f3-740c008e2e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:48.355889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188631a4-abaf-464c-94f3-740c008e2e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:48.357489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-188631a4-abaf-464c-94f3-740c008e2e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:48.467165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188631a4-abaf-464c-94f3-740c008e2e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:48.468552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188631a4-abaf-464c-94f3-740c008e2e69 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:48.487098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 727/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:50.438926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a7241-3725-469d-a802-4e88ba212c17 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:50.439499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a7241-3725-469d-a802-4e88ba212c17 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:50.439499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a7241-3725-469d-a802-4e88ba212c17 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:50.440860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:50.445935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a07029-7c63-4353-a0ec-0e74f66f733f None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:50.446332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a07029-7c63-4353-a0ec-0e74f66f733f None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:50.446487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a07029-7c63-4353-a0ec-0e74f66f733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:50.512305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-30a07029-7c63-4353-a0ec-0e74f66f733f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:50.513517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-30a07029-7c63-4353-a0ec-0e74f66f733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:50.543395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:50.728232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:51.010306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a7241-3725-469d-a802-4e88ba212c17 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:51.011880 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-335a7241-3725-469d-a802-4e88ba212c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:51.110499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a7241-3725-469d-a802-4e88ba212c17 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:51.139796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:51.183944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca350b4-e3e6-4ed3-b667-0021824aca44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:51.184550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca350b4-e3e6-4ed3-b667-0021824aca44 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:51.184831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca350b4-e3e6-4ed3-b667-0021824aca44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:51.185104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca350b4-e3e6-4ed3-b667-0021824aca44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:51.186721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-dca350b4-e3e6-4ed3-b667-0021824aca44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:51.295006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca350b4-e3e6-4ed3-b667-0021824aca44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:51.296415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca350b4-e3e6-4ed3-b667-0021824aca44 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:51.315148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 730/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:53.295174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96c34-c2f0-4f82-9998-4d3f25b21b71 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:53.295684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96c34-c2f0-4f82-9998-4d3f25b21b71 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:53.295684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b96c34-c2f0-4f82-9998-4d3f25b21b71 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:53.297032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:53.303067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155607c7-b023-4fdd-8e53-bf41335f5816 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:53.303488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155607c7-b023-4fdd-8e53-bf41335f5816 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:53.303645 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155607c7-b023-4fdd-8e53-bf41335f5816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:53.368845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-155607c7-b023-4fdd-8e53-bf41335f5816 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:53.370038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-155607c7-b023-4fdd-8e53-bf41335f5816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:53.378918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:53.467913 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:53.749249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b96c34-c2f0-4f82-9998-4d3f25b21b71 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:53.750779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-61b96c34-c2f0-4f82-9998-4d3f25b21b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:53.853957 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b96c34-c2f0-4f82-9998-4d3f25b21b71 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:53.909352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:53.927362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60883b-b7b6-4758-9e93-3b6b74804157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:53.928000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60883b-b7b6-4758-9e93-3b6b74804157 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:53.928281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60883b-b7b6-4758-9e93-3b6b74804157 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:53.928556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60883b-b7b6-4758-9e93-3b6b74804157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:53.930142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3e60883b-b7b6-4758-9e93-3b6b74804157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:54.038163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60883b-b7b6-4758-9e93-3b6b74804157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:54.039555 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60883b-b7b6-4758-9e93-3b6b74804157 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:54.057385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 730/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:56.088120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5806fb-d8bd-41b2-a5d0-b0eb1cecb312 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:56.088673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5806fb-d8bd-41b2-a5d0-b0eb1cecb312 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:56.088673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5806fb-d8bd-41b2-a5d0-b0eb1cecb312 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:56.089931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:56.095171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7deb-c108-4379-9e81-bcb1d026d5c6 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:56.096164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7deb-c108-4379-9e81-bcb1d026d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:56.096263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7deb-c108-4379-9e81-bcb1d026d5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:56.165147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-79fe7deb-c108-4379-9e81-bcb1d026d5c6 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:56.166353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-79fe7deb-c108-4379-9e81-bcb1d026d5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:56.204160 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:56.262700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:56.542657 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5806fb-d8bd-41b2-a5d0-b0eb1cecb312 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:56.544327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8c5806fb-d8bd-41b2-a5d0-b0eb1cecb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:56.644886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5806fb-d8bd-41b2-a5d0-b0eb1cecb312 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:56.682878 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:56.716964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b2cea-eb6f-4e20-bfed-8affe1c864fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:56.717562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2cea-eb6f-4e20-bfed-8affe1c864fb service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:56.717839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2cea-eb6f-4e20-bfed-8affe1c864fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:56.718110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2cea-eb6f-4e20-bfed-8affe1c864fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:56.719682 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8c5b2cea-eb6f-4e20-bfed-8affe1c864fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:56.826355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b2cea-eb6f-4e20-bfed-8affe1c864fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:56.827714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b2cea-eb6f-4e20-bfed-8affe1c864fb service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:56.846070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 733/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:36:58.788677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5f0eb-d7f8-424f-8cc7-e29cd6e7a35c None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:58.789227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5f0eb-d7f8-424f-8cc7-e29cd6e7a35c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:58.789227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5f0eb-d7f8-424f-8cc7-e29cd6e7a35c None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:58.790574 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:36:58.795824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9b0ec-6bfb-41f9-a5de-2314ec28a9d5 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:58.796229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9b0ec-6bfb-41f9-a5de-2314ec28a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:58.796373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9b0ec-6bfb-41f9-a5de-2314ec28a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:58.877968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-69f9b0ec-6bfb-41f9-a5de-2314ec28a9d5 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:36:58.879172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-69f9b0ec-6bfb-41f9-a5de-2314ec28a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:58.897478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:58.978667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:36:59.260244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5f0eb-d7f8-424f-8cc7-e29cd6e7a35c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:36:59.261783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5fb5f0eb-d7f8-424f-8cc7-e29cd6e7a35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:59.363148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5f0eb-d7f8-424f-8cc7-e29cd6e7a35c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:36:59.431095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:36:59.438318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa65a40-9a12-4040-88f6-5d38c688ce68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:36:59.438928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa65a40-9a12-4040-88f6-5d38c688ce68 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:36:59.439250 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa65a40-9a12-4040-88f6-5d38c688ce68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:36:59.439506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa65a40-9a12-4040-88f6-5d38c688ce68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:36:59.441121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-afa65a40-9a12-4040-88f6-5d38c688ce68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:36:59.552713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa65a40-9a12-4040-88f6-5d38c688ce68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:36:59.554053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa65a40-9a12-4040-88f6-5d38c688ce68 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:36:59.572093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 733/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:01.581677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddaf5f-e043-4b67-b929-a3607a2e3158 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:01.582272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddaf5f-e043-4b67-b929-a3607a2e3158 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:01.582272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddaf5f-e043-4b67-b929-a3607a2e3158 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:01.583595 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:01.588736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae102-f997-4e5b-82b2-e0525435ebf1 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:01.589136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae102-f997-4e5b-82b2-e0525435ebf1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:01.589291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae102-f997-4e5b-82b2-e0525435ebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:01.654691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-aa9ae102-f997-4e5b-82b2-e0525435ebf1 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:01.655929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-aa9ae102-f997-4e5b-82b2-e0525435ebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:01.706163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:01.755764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:02.038799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddaf5f-e043-4b67-b929-a3607a2e3158 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:02.040366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c2ddaf5f-e043-4b67-b929-a3607a2e3158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:02.141380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddaf5f-e043-4b67-b929-a3607a2e3158 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:02.194422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:02.220108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77686b83-7adf-4b9b-b1a5-57787e2d4f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:02.221205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686b83-7adf-4b9b-b1a5-57787e2d4f41 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:02.221485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686b83-7adf-4b9b-b1a5-57787e2d4f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:02.221762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686b83-7adf-4b9b-b1a5-57787e2d4f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:02.223353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-77686b83-7adf-4b9b-b1a5-57787e2d4f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:02.329690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77686b83-7adf-4b9b-b1a5-57787e2d4f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:02.331168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77686b83-7adf-4b9b-b1a5-57787e2d4f41 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:02.349282 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 736/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:11.753996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=22 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:12.347089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=66 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:22.563090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5ba9-fa71-48cf-963d-dd8aef4e2f89 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:22.563632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5ba9-fa71-48cf-963d-dd8aef4e2f89 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:22.563632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5ba9-fa71-48cf-963d-dd8aef4e2f89 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:22.565030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 735/1471] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:22.570850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05282b8-60a6-4750-a5c3-44339d290b4d None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:22.571261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05282b8-60a6-4750-a5c3-44339d290b4d None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:22.571424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05282b8-60a6-4750-a5c3-44339d290b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:22.635992 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-d05282b8-60a6-4750-a5c3-44339d290b4d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:22.637191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d05282b8-60a6-4750-a5c3-44339d290b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:22.730543 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 737/1472] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:37:23.025911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3674ed-f7ee-41f8-abf5-3ec72b86af76 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:23.026195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3674ed-f7ee-41f8-abf5-3ec72b86af76 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:23.026468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3674ed-f7ee-41f8-abf5-3ec72b86af76 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:23.027869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 736/1473] 10.222.0.55 () {54 vars in 967 bytes} [Thu Sep 1 15:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:23.032626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d8d4-e4fb-4d73-8e53-7ecb4492c663 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:23.032915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d8d4-e4fb-4d73-8e53-7ecb4492c663 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:23.033191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d8d4-e4fb-4d73-8e53-7ecb4492c663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:23.107562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c4c7d8d4-e4fb-4d73-8e53-7ecb4492c663 None None] MFA Rules not processed for user `df1a3f053649456d982dd6c2d45d23c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:23.108799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c4c7d8d4-e4fb-4d73-8e53-7ecb4492c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:23.129429 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:23.184778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 738/1474] 10.222.0.55 () {58 vars in 1064 bytes} [Thu Sep 1 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:23.192459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3674ed-f7ee-41f8-abf5-3ec72b86af76 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:23.194029 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-8a3674ed-f7ee-41f8-abf5-3ec72b86af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:23.295745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3674ed-f7ee-41f8-abf5-3ec72b86af76 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:23.365708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fccebc-693e-4d7f-9242-c41a8dd765d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df1a3f053649456d982dd6c2d45d23c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:23.366307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fccebc-693e-4d7f-9242-c41a8dd765d3 service glance] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:23.366584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fccebc-693e-4d7f-9242-c41a8dd765d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:23.366850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fccebc-693e-4d7f-9242-c41a8dd765d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:23.368447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f4fccebc-693e-4d7f-9242-c41a8dd765d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:23.420651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:23.474971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fccebc-693e-4d7f-9242-c41a8dd765d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:23.476431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fccebc-693e-4d7f-9242-c41a8dd765d3 service glance] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:23.494286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 737/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:25.461563 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087aab1-ec3e-4f06-bec0-ae4e6d0e985e None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:25.462120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087aab1-ec3e-4f06-bec0-ae4e6d0e985e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:25.462120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087aab1-ec3e-4f06-bec0-ae4e6d0e985e None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:25.463480 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 739/1476] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:25.468919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a1b05-60e1-4105-a0e5-feff607ce4e1 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:25.469341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a1b05-60e1-4105-a0e5-feff607ce4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:25.469508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a1b05-60e1-4105-a0e5-feff607ce4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:25.534984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-042a1b05-60e1-4105-a0e5-feff607ce4e1 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:25.536222 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-042a1b05-60e1-4105-a0e5-feff607ce4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:25.632517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 738/1477] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:25.922554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087aab1-ec3e-4f06-bec0-ae4e6d0e985e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:25.924124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6087aab1-ec3e-4f06-bec0-ae4e6d0e985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:26.048852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087aab1-ec3e-4f06-bec0-ae4e6d0e985e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:26.096882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:26.142735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565e7bb-30b9-417b-a2bb-3bd40898f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:26.143344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e7bb-30b9-417b-a2bb-3bd40898f24b admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:26.143618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e7bb-30b9-417b-a2bb-3bd40898f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:26.143922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e7bb-30b9-417b-a2bb-3bd40898f24b admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:26.145069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565e7bb-30b9-417b-a2bb-3bd40898f24b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:26.146796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING py.warnings [None req-7565e7bb-30b9-417b-a2bb-3bd40898f24b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:37:26.146796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: warnings.warn(msg) Sep 01 15:37:26.146796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: Sep 01 15:37:26.147962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565e7bb-30b9-417b-a2bb-3bd40898f24b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:26.166656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 740/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Thu Sep 1 15:37:25 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:37:28.056955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a616c-27e6-4cc0-ae65-ce73ebe9e5f4 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:28.057504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a616c-27e6-4cc0-ae65-ce73ebe9e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:28.057504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a616c-27e6-4cc0-ae65-ce73ebe9e5f4 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:28.058846 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 739/1479] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:28.063932 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3e60-72ee-4379-8fa5-4bae77b21235 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:28.064414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3e60-72ee-4379-8fa5-4bae77b21235 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:28.064523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e3e60-72ee-4379-8fa5-4bae77b21235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:28.129562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-094e3e60-72ee-4379-8fa5-4bae77b21235 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:28.130853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-094e3e60-72ee-4379-8fa5-4bae77b21235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:28.225187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 741/1480] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:28.516540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a616c-27e6-4cc0-ae65-ce73ebe9e5f4 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:28.518062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-017a616c-27e6-4cc0-ae65-ce73ebe9e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:28.528287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:28.660810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a616c-27e6-4cc0-ae65-ce73ebe9e5f4 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:28.740550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:28.773214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dd11d-36fe-4db5-899d-2a2c79964346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:28.773761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd11d-36fe-4db5-899d-2a2c79964346 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:28.774042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd11d-36fe-4db5-899d-2a2c79964346 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:28.774319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd11d-36fe-4db5-899d-2a2c79964346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:28.775954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9f5dd11d-36fe-4db5-899d-2a2c79964346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:28.863732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dd11d-36fe-4db5-899d-2a2c79964346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:28.865348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dd11d-36fe-4db5-899d-2a2c79964346 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:28.883006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 740/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:30.982963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf081f8-0521-4f0f-9e55-018e8e40a40a None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:30.983492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf081f8-0521-4f0f-9e55-018e8e40a40a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:30.983598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf081f8-0521-4f0f-9e55-018e8e40a40a None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:30.984931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 742/1482] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:30.990743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8312-329a-4407-b50c-358771294680 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:30.991177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8312-329a-4407-b50c-358771294680 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:30.991307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8312-329a-4407-b50c-358771294680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:31.057200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-465a8312-329a-4407-b50c-358771294680 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:31.058417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-465a8312-329a-4407-b50c-358771294680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:31.107577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:31.157714 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 741/1483] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:31.447688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf081f8-0521-4f0f-9e55-018e8e40a40a None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:31.449266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-acf081f8-0521-4f0f-9e55-018e8e40a40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:31.473328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:31.551872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf081f8-0521-4f0f-9e55-018e8e40a40a None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:31.622609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695054f-1530-47c6-87a3-a88e0b562bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:31.623215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695054f-1530-47c6-87a3-a88e0b562bab service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:31.623494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695054f-1530-47c6-87a3-a88e0b562bab service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:31.623796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695054f-1530-47c6-87a3-a88e0b562bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:31.625394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2695054f-1530-47c6-87a3-a88e0b562bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:31.699209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:31.735118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695054f-1530-47c6-87a3-a88e0b562bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:31.736606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695054f-1530-47c6-87a3-a88e0b562bab service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:31.755074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 743/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:33.729079 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a448-befb-41a1-bb1d-159842712ff2 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:33.729959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a448-befb-41a1-bb1d-159842712ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:33.729959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a448-befb-41a1-bb1d-159842712ff2 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:33.731014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 742/1485] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:37:33.736405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a894d49-19d4-478e-8e81-6f3941475c8e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:33.736854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a894d49-19d4-478e-8e81-6f3941475c8e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:33.736967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a894d49-19d4-478e-8e81-6f3941475c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:33.801485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4a894d49-19d4-478e-8e81-6f3941475c8e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:33.802686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4a894d49-19d4-478e-8e81-6f3941475c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:33.899798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 744/1486] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:37:34.194074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a448-befb-41a1-bb1d-159842712ff2 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:34.195664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-cea8a448-befb-41a1-bb1d-159842712ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:34.307216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a448-befb-41a1-bb1d-159842712ff2 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:34.380166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:34.381993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d58975-015e-428a-a2e6-397bda60bff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:34.382647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d58975-015e-428a-a2e6-397bda60bff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:34.383123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d58975-015e-428a-a2e6-397bda60bff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:34.383625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d58975-015e-428a-a2e6-397bda60bff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:34.385690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-27d58975-015e-428a-a2e6-397bda60bff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:34.500256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d58975-015e-428a-a2e6-397bda60bff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:34.502093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d58975-015e-428a-a2e6-397bda60bff6 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:34.520887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 743/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:36.524646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbaa9e-2717-42bc-bbd8-eb80849a6b40 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:36.525228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbaa9e-2717-42bc-bbd8-eb80849a6b40 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:36.525228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbaa9e-2717-42bc-bbd8-eb80849a6b40 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:36.526553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 745/1488] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:36.531603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c3f5-302a-412d-933b-5a2e38464d9c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:36.532019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c3f5-302a-412d-933b-5a2e38464d9c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:36.532205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c3f5-302a-412d-933b-5a2e38464d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:36.597310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-f8a7c3f5-302a-412d-933b-5a2e38464d9c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:36.598519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f8a7c3f5-302a-412d-933b-5a2e38464d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:36.650797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:36.694778 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 744/1489] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:36.980421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbaa9e-2717-42bc-bbd8-eb80849a6b40 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:36.982014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-51bbaa9e-2717-42bc-bbd8-eb80849a6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:37.017428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:37.085174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbaa9e-2717-42bc-bbd8-eb80849a6b40 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:37.156230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f99a3-a4fe-4acc-991c-7ad40e2f6602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:37.156843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f99a3-a4fe-4acc-991c-7ad40e2f6602 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:37.157125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f99a3-a4fe-4acc-991c-7ad40e2f6602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:37.157397 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f99a3-a4fe-4acc-991c-7ad40e2f6602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:37.158989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f59f99a3-a4fe-4acc-991c-7ad40e2f6602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:37.238607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:37.267739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f99a3-a4fe-4acc-991c-7ad40e2f6602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:37.269278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f99a3-a4fe-4acc-991c-7ad40e2f6602 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:37.287653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 746/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:39.397833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db96a-9e30-4eac-b3fd-b96cb5e16cc6 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:39.398372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db96a-9e30-4eac-b3fd-b96cb5e16cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:39.398372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db96a-9e30-4eac-b3fd-b96cb5e16cc6 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:39.399667 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 745/1491] 10.222.0.55 () {54 vars in 927 bytes} [Thu Sep 1 15:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:37:39.405662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f496-751f-438c-8f05-08f6c90e306e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:39.406394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f496-751f-438c-8f05-08f6c90e306e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:39.406394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f496-751f-438c-8f05-08f6c90e306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:39.471473 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c4d8f496-751f-438c-8f05-08f6c90e306e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:37:39.472735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c4d8f496-751f-438c-8f05-08f6c90e306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:39.569605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 747/1492] 10.222.0.55 () {58 vars in 1024 bytes} [Thu Sep 1 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:37:39.866120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db96a-9e30-4eac-b3fd-b96cb5e16cc6 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:37:39.867683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0c7db96a-9e30-4eac-b3fd-b96cb5e16cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:39.975251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db96a-9e30-4eac-b3fd-b96cb5e16cc6 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:37:40.047572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087348aa-3972-44fd-8d43-fd723d3607c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:37:40.048149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087348aa-3972-44fd-8d43-fd723d3607c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:37:40.048432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087348aa-3972-44fd-8d43-fd723d3607c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:37:40.048703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087348aa-3972-44fd-8d43-fd723d3607c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:37:40.050307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-087348aa-3972-44fd-8d43-fd723d3607c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:37:40.059298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:40.162559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087348aa-3972-44fd-8d43-fd723d3607c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:37:40.164013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087348aa-3972-44fd-8d43-fd723d3607c7 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:37:40.181576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 746/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:37:49.567820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=82 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:37:50.179305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=50 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:06.984215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52821db-e1c7-4c32-8b25-06a000a1906e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:06.984768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52821db-e1c7-4c32-8b25-06a000a1906e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:06.984768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52821db-e1c7-4c32-8b25-06a000a1906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:07.059643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c52821db-e1c7-4c32-8b25-06a000a1906e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:07.061147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c52821db-e1c7-4c32-8b25-06a000a1906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:07.155991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 748/1494] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:07.164612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b30d-dcae-43b9-99da-d1966f696b16 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:07.165107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b30d-dcae-43b9-99da-d1966f696b16 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:07.165210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b30d-dcae-43b9-99da-d1966f696b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:07.240162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c1b3b30d-dcae-43b9-99da-d1966f696b16 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:07.241300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c1b3b30d-dcae-43b9-99da-d1966f696b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:07.336098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 747/1495] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:39:07.340671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52821db-e1c7-4c32-8b25-06a000a1906e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:07.341925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c52821db-e1c7-4c32-8b25-06a000a1906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:07.354186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52821db-e1c7-4c32-8b25-06a000a1906e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:07.414980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:07.448031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:07.448678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:07.448955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:07.449218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:07.449846 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:39:07.450141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:07.451150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING py.warnings [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:07.451150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: warnings.warn(msg) Sep 01 15:39:07.451150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: Sep 01 15:39:07.452057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:07.463318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 749/1496] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:39:07.471657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3b30d-dcae-43b9-99da-d1966f696b16 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:07.481326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3b30d-dcae-43b9-99da-d1966f696b16 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:07.542139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:07.575133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:07.575736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:07.576053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:07.576329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:07.576955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:07.578664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING py.warnings [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:07.578664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: warnings.warn(msg) Sep 01 15:39:07.578664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: Sep 01 15:39:07.579889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:07.636225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 748/1497] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:39:07 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:39:07.640417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:07.641953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:07.674790 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f93a5c-4df7-47f9-882d-4e0be83197db admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:07.767118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:07.767733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:07.768050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:07.768319 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:07.768950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:07.769965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING py.warnings [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:07.769965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: warnings.warn(msg) Sep 01 15:39:07.769965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: Sep 01 15:39:07.771786 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:07.812010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 750/1498] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:39:07 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:39:07.816159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:07.818168 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:07.878713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b797f-1555-41bf-8dbe-fef21e505aab admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:07.963499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:07.974610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:07.975215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:07.975493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:07.975763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:07.976431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:07.977430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING py.warnings [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:07.977430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: warnings.warn(msg) Sep 01 15:39:07.977430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: Sep 01 15:39:07.978308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:07.990373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 749/1499] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:39:07.994416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:07.995988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:08.007884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f4100-a28f-4b17-9350-1acfad58fd18 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:08.033341 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:08.102907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899d7b4-5f11-4f4e-b542-13b11a78b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:08.103437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899d7b4-5f11-4f4e-b542-13b11a78b88e admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:08.103715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899d7b4-5f11-4f4e-b542-13b11a78b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:08.104017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899d7b4-5f11-4f4e-b542-13b11a78b88e admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:08.104653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899d7b4-5f11-4f4e-b542-13b11a78b88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:08.105662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING py.warnings [None req-e899d7b4-5f11-4f4e-b542-13b11a78b88e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:08.105662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: warnings.warn(msg) Sep 01 15:39:08.105662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: Sep 01 15:39:08.106547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899d7b4-5f11-4f4e-b542-13b11a78b88e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:08.119120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 751/1500] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:39:08.123260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:08.124831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:08.157944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd1c05-6f31-4fdd-8c0f-633624093559 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:08.249835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa94d6-e44e-4c18-bd5c-0329285252fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:08.250488 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa94d6-e44e-4c18-bd5c-0329285252fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:08.250767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa94d6-e44e-4c18-bd5c-0329285252fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:08.251042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa94d6-e44e-4c18-bd5c-0329285252fe admin admin] PATH_INFO: `/v3/projects/69cdf2ae09184b088980fdd0f7614f43/users/ee0902786d774405a0571d896f846ac8/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:08.273514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa94d6-e44e-4c18-bd5c-0329285252fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cdf2ae09184b088980fdd0f7614f43, user_id=ee0902786d774405a0571d896f846ac8, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:08.274539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING py.warnings [None req-51fa94d6-e44e-4c18-bd5c-0329285252fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:08.274539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: warnings.warn(msg) Sep 01 15:39:08.274539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: Sep 01 15:39:08.276540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa94d6-e44e-4c18-bd5c-0329285252fe admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:08.300492 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 750/1501] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:39:08 2022] PUT /identity/v3/projects/69cdf2ae09184b088980fdd0f7614f43/users/ee0902786d774405a0571d896f846ac8/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:39:08.313491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3bc4-ae26-4cd3-956c-828006a4e864 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:08.313780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3bc4-ae26-4cd3-956c-828006a4e864 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:08.314058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3bc4-ae26-4cd3-956c-828006a4e864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:08.370604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-860d3bc4-ae26-4cd3-956c-828006a4e864 None None] MFA Rules not processed for user `ee0902786d774405a0571d896f846ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:08.371748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-860d3bc4-ae26-4cd3-956c-828006a4e864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:08.448860 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 752/1502] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:08.461955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed8a2-d3bc-4c35-89b7-4b462c7ff3ef None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:08.462270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed8a2-d3bc-4c35-89b7-4b462c7ff3ef None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:08.462551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed8a2-d3bc-4c35-89b7-4b462c7ff3ef None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:08.463929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 751/1503] 10.222.0.55 () {54 vars in 964 bytes} [Thu Sep 1 15:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:39:08.468902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c816d9-5b55-4516-a4e3-2cdd1097f030 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:08.469192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c816d9-5b55-4516-a4e3-2cdd1097f030 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:08.469473 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c816d9-5b55-4516-a4e3-2cdd1097f030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:08.501852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:08.545787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-49c816d9-5b55-4516-a4e3-2cdd1097f030 None None] MFA Rules not processed for user `a9abba87fe6b44e5850d79dbd8d52469`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:08.546981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-49c816d9-5b55-4516-a4e3-2cdd1097f030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:08.620238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 753/1504] 10.222.0.55 () {58 vars in 1061 bytes} [Thu Sep 1 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:08.629908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed8a2-d3bc-4c35-89b7-4b462c7ff3ef None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:08.631385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a06ed8a2-d3bc-4c35-89b7-4b462c7ff3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:08.680806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:08.735990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed8a2-d3bc-4c35-89b7-4b462c7ff3ef None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:08.808392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:08.808999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:08.809278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:08.809550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:08.811129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:08.906645 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:08.908022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:08.912082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:08.926824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 752/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:39:08.972513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb143c12-5f61-476c-b717-889f29538e60 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:08.972804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb143c12-5f61-476c-b717-889f29538e60 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:08.973084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb143c12-5f61-476c-b717-889f29538e60 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:08.974989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 754/1506] 10.222.0.55 () {52 vars in 830 bytes} [Thu Sep 1 15:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:39:08.978509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:08.979750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:09.078063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5c3d2-0a2a-455c-95ac-b172225a52b2 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:09.170669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:09.171232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:09.171510 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:09.171798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] PATH_INFO: `/v3/users/ee0902786d774405a0571d896f846ac8` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:09.183939 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0902786d774405a0571d896f846ac8)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:09.184960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING py.warnings [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:09.184960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: warnings.warn(msg) Sep 01 15:39:09.184960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: Sep 01 15:39:09.186174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:09.196208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:09.250815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0902786d774405a0571d896f846ac8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:09.265219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0902786d774405a0571d896f846ac8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:09.274578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0902786d774405a0571d896f846ac8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:09.275006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0902786d774405a0571d896f846ac8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:09.297073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0902786d774405a0571d896f846ac8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:09.302616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 753/1507] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:39:08 2022] DELETE /identity/v3/users/ee0902786d774405a0571d896f846ac8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:39:09.306953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8a66-ca20-4abe-aa6c-ab2d115f693b None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:09.307406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8a66-ca20-4abe-aa6c-ab2d115f693b None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:09.307510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a8a66-ca20-4abe-aa6c-ab2d115f693b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:09.364405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-e86a8a66-ca20-4abe-aa6c-ab2d115f693b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:39:09.365601 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e86a8a66-ca20-4abe-aa6c-ab2d115f693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:09.439693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:09.453171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 755/1508] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:39:09.463757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:09.464989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:09.563923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c92f5-c238-41ea-a014-1940dda8ac2a admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:09.617986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:09.638497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f8ede-fc22-4db4-b6bf-904607e37abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:09.639106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8ede-fc22-4db4-b6bf-904607e37abe service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:09.639390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8ede-fc22-4db4-b6bf-904607e37abe service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:09.639661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f8ede-fc22-4db4-b6bf-904607e37abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:09.641255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f79f8ede-fc22-4db4-b6bf-904607e37abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:09.747447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f8ede-fc22-4db4-b6bf-904607e37abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:09.748822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f8ede-fc22-4db4-b6bf-904607e37abe service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:09.767478 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 754/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:39:10.123110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a8a66-ca20-4abe-aa6c-ab2d115f693b None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:39:10.124379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e86a8a66-ca20-4abe-aa6c-ab2d115f693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:39:10.136894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a8a66-ca20-4abe-aa6c-ab2d115f693b None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:39:10.235188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:39:10.235861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:39:10.236142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:39:10.236415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] PATH_INFO: `/v3/projects/69cdf2ae09184b088980fdd0f7614f43` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:39:10.246230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cdf2ae09184b088980fdd0f7614f43)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:39:10.247267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING py.warnings [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:39:10.247267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: warnings.warn(msg) Sep 01 15:39:10.247267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: Sep 01 15:39:10.248521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:39:10.305462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cdf2ae09184b088980fdd0f7614f43', 'request_id': 'req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:10.318625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cdf2ae09184b088980fdd0f7614f43', 'request_id': 'req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:10.324633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cdf2ae09184b088980fdd0f7614f43', 'request_id': 'req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:10.349870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] The token cache is being invalidate because project 69cdf2ae09184b088980fdd0f7614f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:39:10.350162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:10.350677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-54fc3c4c-92ac-4376-9244-2b1cae07bbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:39:10.352015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 756/1510] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:39:10 2022] DELETE /identity/v3/projects/69cdf2ae09184b088980fdd0f7614f43 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:39:19.765214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=62 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:39:20.347660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:40:36.484062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581c59-5f5e-443f-a54f-76cbd6153584 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:36.484622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581c59-5f5e-443f-a54f-76cbd6153584 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:36.484622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581c59-5f5e-443f-a54f-76cbd6153584 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:36.486026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:40:36.491450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ff1a5-392b-47bf-98d5-22625a809299 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:36.491902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ff1a5-392b-47bf-98d5-22625a809299 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:36.492010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ff1a5-392b-47bf-98d5-22625a809299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:36.572238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-865ff1a5-392b-47bf-98d5-22625a809299 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:40:36.573443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-865ff1a5-392b-47bf-98d5-22625a809299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:36.676182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:40:36.830747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581c59-5f5e-443f-a54f-76cbd6153584 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:40:36.832920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-e8581c59-5f5e-443f-a54f-76cbd6153584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:36.951962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581c59-5f5e-443f-a54f-76cbd6153584 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:40:36.957983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e0fb-168e-4429-bf04-4ac77b817835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:40:36.959093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e0fb-168e-4429-bf04-4ac77b817835 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:36.959376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e0fb-168e-4429-bf04-4ac77b817835 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:36.959650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e0fb-168e-4429-bf04-4ac77b817835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:36.968112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506e0fb-168e-4429-bf04-4ac77b817835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:40:36.969696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506e0fb-168e-4429-bf04-4ac77b817835 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:40:36.979767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 756/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:40:37.796183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010aae4-3de4-4a0f-ab17-1ca30b26ebe8 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:37.796804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010aae4-3de4-4a0f-ab17-1ca30b26ebe8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:37.796804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010aae4-3de4-4a0f-ab17-1ca30b26ebe8 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:37.798054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:40:37.803258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1dfd-74e7-41a6-b2a7-aeed77acb24e None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:37.803662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1dfd-74e7-41a6-b2a7-aeed77acb24e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:37.803966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1dfd-74e7-41a6-b2a7-aeed77acb24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:37.824051 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-9ddc1dfd-74e7-41a6-b2a7-aeed77acb24e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:40:37.825253 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9ddc1dfd-74e7-41a6-b2a7-aeed77acb24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:37.833101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:40:37.985515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010aae4-3de4-4a0f-ab17-1ca30b26ebe8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:40:38.000192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010aae4-3de4-4a0f-ab17-1ca30b26ebe8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:40:38.006240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0742d-d908-4251-97fd-34cc5dfe316d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:40:38.006832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0742d-d908-4251-97fd-34cc5dfe316d service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:38.007110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0742d-d908-4251-97fd-34cc5dfe316d service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:38.007377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0742d-d908-4251-97fd-34cc5dfe316d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:38.015702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0742d-d908-4251-97fd-34cc5dfe316d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:40:38.017310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0742d-d908-4251-97fd-34cc5dfe316d service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:40:38.026491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 759/1516] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:40:38.234358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9d8e-80a9-406b-9346-25c59669bbf9 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:38.234641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9d8e-80a9-406b-9346-25c59669bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:38.234917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d9d8e-80a9-406b-9346-25c59669bbf9 None None] PATH_INFO: `/v3` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:38.236274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 758/1517] 10.222.0.46 () {54 vars in 925 bytes} [Thu Sep 1 15:40:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:40:38.242438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c2f66-5ee9-4e99-b526-7a4ee9a7985e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:38.242726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c2f66-5ee9-4e99-b526-7a4ee9a7985e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:38.243006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c2f66-5ee9-4e99-b526-7a4ee9a7985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:38.300513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-511c2f66-5ee9-4e99-b526-7a4ee9a7985e None None] MFA Rules not processed for user `99ee78db03794fbcb572ca1e98f231fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:40:38.301705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-511c2f66-5ee9-4e99-b526-7a4ee9a7985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:38.318673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:40:38.372377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 760/1518] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Sep 1 15:40:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:40:47.182378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cdf97-95a5-4746-8b91-c99e4ba2c2ef None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:47.182903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cdf97-95a5-4746-8b91-c99e4ba2c2ef None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:47.182903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cdf97-95a5-4746-8b91-c99e4ba2c2ef None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:47.184218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 759/1519] 10.222.0.55 () {54 vars in 961 bytes} [Thu Sep 1 15:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:40:47.189190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b0b1d-9176-4920-95f9-892d4212548c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:47.189578 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b0b1d-9176-4920-95f9-892d4212548c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:47.189747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b0b1d-9176-4920-95f9-892d4212548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:47.209524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6b5b0b1d-9176-4920-95f9-892d4212548c None None] MFA Rules not processed for user `99ee78db03794fbcb572ca1e98f231fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:40:47.210722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6b5b0b1d-9176-4920-95f9-892d4212548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:47.219254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 761/1520] 10.222.0.55 () {58 vars in 1058 bytes} [Thu Sep 1 15:40:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:40:47.226450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cdf97-95a5-4746-8b91-c99e4ba2c2ef None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:40:47.239648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cdf97-95a5-4746-8b91-c99e4ba2c2ef None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:40:47.245147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924545-a601-43ec-b3fa-5767959568da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ee78db03794fbcb572ca1e98f231fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:40:47.245729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924545-a601-43ec-b3fa-5767959568da service placement] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:47.246007 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924545-a601-43ec-b3fa-5767959568da service placement] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:47.246278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924545-a601-43ec-b3fa-5767959568da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:47.254303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff924545-a601-43ec-b3fa-5767959568da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:40:47.255940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff924545-a601-43ec-b3fa-5767959568da service placement] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:40:47.266175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 760/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:40:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:40:49.244500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0193-c22d-4800-b55c-1eb528aee0c1 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:49.245032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0193-c22d-4800-b55c-1eb528aee0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:49.245032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff0193-c22d-4800-b55c-1eb528aee0c1 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:49.246337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:40:49.251220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de96ed-3b34-4d6c-a8ba-0aa2dc451156 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:49.251620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de96ed-3b34-4d6c-a8ba-0aa2dc451156 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:49.251797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de96ed-3b34-4d6c-a8ba-0aa2dc451156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:49.271094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-e0de96ed-3b34-4d6c-a8ba-0aa2dc451156 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:40:49.272348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-e0de96ed-3b34-4d6c-a8ba-0aa2dc451156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:49.280083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:40:49.432207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff0193-c22d-4800-b55c-1eb528aee0c1 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:40:49.446676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff0193-c22d-4800-b55c-1eb528aee0c1 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:40:49.452300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f62853-d05b-4206-b959-deb359349c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:40:49.452978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62853-d05b-4206-b959-deb359349c6e service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:49.453313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62853-d05b-4206-b959-deb359349c6e service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:49.453644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62853-d05b-4206-b959-deb359349c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:49.462606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f62853-d05b-4206-b959-deb359349c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:40:49.464244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f62853-d05b-4206-b959-deb359349c6e service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:40:49.473484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 763/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:40:50.289641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe43cc-621a-4018-8d2f-0fac836e94d2 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:50.290207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe43cc-621a-4018-8d2f-0fac836e94d2 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:50.290207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe43cc-621a-4018-8d2f-0fac836e94d2 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:50.291543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 15:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:40:50.296265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6dd8-77f3-40db-acee-4a77b8793f31 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:50.296698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6dd8-77f3-40db-acee-4a77b8793f31 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:50.296821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e6dd8-77f3-40db-acee-4a77b8793f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:50.316625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-d41e6dd8-77f3-40db-acee-4a77b8793f31 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:40:50.317822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d41e6dd8-77f3-40db-acee-4a77b8793f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:50.326329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 15:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:40:50.479796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe43cc-621a-4018-8d2f-0fac836e94d2 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:40:50.494704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe43cc-621a-4018-8d2f-0fac836e94d2 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:40:50.500203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a48c98-15ca-4b36-bc73-cea3132ae935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:40:50.500807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a48c98-15ca-4b36-bc73-cea3132ae935 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:50.501088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a48c98-15ca-4b36-bc73-cea3132ae935 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:50.501364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a48c98-15ca-4b36-bc73-cea3132ae935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:50.509346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a48c98-15ca-4b36-bc73-cea3132ae935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:40:50.511185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a48c98-15ca-4b36-bc73-cea3132ae935 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:40:50.520621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 763/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:40:54.465463 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f5196-37c7-4ef2-bd33-7f9ab79e483d None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:54.466012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f5196-37c7-4ef2-bd33-7f9ab79e483d None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:54.466012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f5196-37c7-4ef2-bd33-7f9ab79e483d None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:54.467360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:40:54.472475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11785c9b-5301-4943-8d51-8599f34b57ba None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:54.472874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11785c9b-5301-4943-8d51-8599f34b57ba None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:54.473037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11785c9b-5301-4943-8d51-8599f34b57ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:54.493366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-11785c9b-5301-4943-8d51-8599f34b57ba None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:40:54.494540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-11785c9b-5301-4943-8d51-8599f34b57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:54.502380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:40:54.790275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f5196-37c7-4ef2-bd33-7f9ab79e483d None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:40:54.792011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d03f5196-37c7-4ef2-bd33-7f9ab79e483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:54.870267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f5196-37c7-4ef2-bd33-7f9ab79e483d None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:40:54.874117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f7eea-220e-4748-9923-895abde892a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:40:54.874721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f7eea-220e-4748-9923-895abde892a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:54.875006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f7eea-220e-4748-9923-895abde892a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:54.875283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f7eea-220e-4748-9923-895abde892a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:54.885140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f7eea-220e-4748-9923-895abde892a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:40:54.886580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f7eea-220e-4748-9923-895abde892a0 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:40:54.895930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 766/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:40:56.787311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246e54-a496-4489-9d4d-8101636ff7bf None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:56.787906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246e54-a496-4489-9d4d-8101636ff7bf None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:56.787906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28246e54-a496-4489-9d4d-8101636ff7bf None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:56.789279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:40:56.794504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01c01-f96a-42a6-99c6-0279c4f1ad9c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:56.794946 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01c01-f96a-42a6-99c6-0279c4f1ad9c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:56.795067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01c01-f96a-42a6-99c6-0279c4f1ad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:56.814876 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ebc01c01-f96a-42a6-99c6-0279c4f1ad9c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:40:56.816114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ebc01c01-f96a-42a6-99c6-0279c4f1ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:56.824599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:40:57.110653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28246e54-a496-4489-9d4d-8101636ff7bf None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:40:57.112367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-28246e54-a496-4489-9d4d-8101636ff7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:40:57.125676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28246e54-a496-4489-9d4d-8101636ff7bf None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:40:57.129173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdae1b-f0a0-45b4-bc77-84097539c7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:40:57.129767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdae1b-f0a0-45b4-bc77-84097539c7bd service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:40:57.130046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdae1b-f0a0-45b4-bc77-84097539c7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:40:57.130320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdae1b-f0a0-45b4-bc77-84097539c7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:40:57.140008 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdae1b-f0a0-45b4-bc77-84097539c7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:40:57.141413 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdae1b-f0a0-45b4-bc77-84097539c7bd service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:40:57.151156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 766/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:00.910335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e431-a57d-42b5-a259-1f3965075525 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:00.910987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e431-a57d-42b5-a259-1f3965075525 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:00.910987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e431-a57d-42b5-a259-1f3965075525 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:00.912283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:00.917554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9f402-c5e8-4c60-83dd-90d40758992d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:00.917996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9f402-c5e8-4c60-83dd-90d40758992d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:00.918136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9f402-c5e8-4c60-83dd-90d40758992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:00.925696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=81 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:41:00.938068 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-75a9f402-c5e8-4c60-83dd-90d40758992d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:00.939257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-75a9f402-c5e8-4c60-83dd-90d40758992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:00.947592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:41:01.494289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33e431-a57d-42b5-a259-1f3965075525 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:01.495997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8e33e431-a57d-42b5-a259-1f3965075525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:01.560059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:41:01.573336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33e431-a57d-42b5-a259-1f3965075525 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:01.576924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba188c75-1b92-438f-94eb-ee32951a5e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:01.577516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188c75-1b92-438f-94eb-ee32951a5e97 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:01.577796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188c75-1b92-438f-94eb-ee32951a5e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:01.578067 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188c75-1b92-438f-94eb-ee32951a5e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:01.587178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba188c75-1b92-438f-94eb-ee32951a5e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:01.588640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba188c75-1b92-438f-94eb-ee32951a5e97 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:01.597654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 769/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:03.487370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaca47-3bba-46bb-a665-c70b4ae9cc11 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:03.487994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaca47-3bba-46bb-a665-c70b4ae9cc11 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:03.487994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaca47-3bba-46bb-a665-c70b4ae9cc11 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:03.489371 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 15:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:41:03.495374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd4b68-5f9c-487b-9d8e-25624a835f13 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:03.495824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd4b68-5f9c-487b-9d8e-25624a835f13 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:03.495949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd4b68-5f9c-487b-9d8e-25624a835f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:03.515747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-adcd4b68-5f9c-487b-9d8e-25624a835f13 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:41:03.516980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-adcd4b68-5f9c-487b-9d8e-25624a835f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:03.526118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:41:04.080678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaca47-3bba-46bb-a665-c70b4ae9cc11 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:41:04.082374 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5dcaca47-3bba-46bb-a665-c70b4ae9cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:41:04.095837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaca47-3bba-46bb-a665-c70b4ae9cc11 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:41:04.099294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2723a82-ca42-47ec-96c3-784629edfc06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:41:04.099923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723a82-ca42-47ec-96c3-784629edfc06 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:41:04.100204 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723a82-ca42-47ec-96c3-784629edfc06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:41:04.100476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723a82-ca42-47ec-96c3-784629edfc06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:41:04.109308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2723a82-ca42-47ec-96c3-784629edfc06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:41:04.110660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2723a82-ca42-47ec-96c3-784629edfc06 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:41:04.120022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 769/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:41:13.510928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=11 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:41:14.115895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=8 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:27.258056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d854e8-1201-4b9d-af80-1fefe1521c78 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.259070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d854e8-1201-4b9d-af80-1fefe1521c78 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.259546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d854e8-1201-4b9d-af80-1fefe1521c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.293223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-88d854e8-1201-4b9d-af80-1fefe1521c78 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.294492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-88d854e8-1201-4b9d-af80-1fefe1521c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.305299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 771/1540] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.315430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247b264-3d7d-49c1-911a-c0501aa4e137 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.316054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247b264-3d7d-49c1-911a-c0501aa4e137 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.316054 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247b264-3d7d-49c1-911a-c0501aa4e137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.347046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5247b264-3d7d-49c1-911a-c0501aa4e137 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.348365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5247b264-3d7d-49c1-911a-c0501aa4e137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.362178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 770/1541] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.367051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d854e8-1201-4b9d-af80-1fefe1521c78 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.378646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d854e8-1201-4b9d-af80-1fefe1521c78 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.388305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.388942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.389270 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.389547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.390201 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:27.390502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.392163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.412148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 772/1542] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:27.417564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247b264-3d7d-49c1-911a-c0501aa4e137 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.432968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247b264-3d7d-49c1-911a-c0501aa4e137 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.444895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ecc05-4a9f-49ae-96f8-788243826239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.445552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ecc05-4a9f-49ae-96f8-788243826239 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.445837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ecc05-4a9f-49ae-96f8-788243826239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.446113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ecc05-4a9f-49ae-96f8-788243826239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.446774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ecc05-4a9f-49ae-96f8-788243826239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.449091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ecc05-4a9f-49ae-96f8-788243826239 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.510043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 771/1543] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:27.514147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.532306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d660a3-00eb-4484-8131-de1f7ac46d48 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.612639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc320fa-51c5-4e63-a353-30bc4d3eee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.613661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc320fa-51c5-4e63-a353-30bc4d3eee1f admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.614193 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc320fa-51c5-4e63-a353-30bc4d3eee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.614692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc320fa-51c5-4e63-a353-30bc4d3eee1f admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.615554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc320fa-51c5-4e63-a353-30bc4d3eee1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.617711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc320fa-51c5-4e63-a353-30bc4d3eee1f admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.629277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28abbe8-8cd9-49be-beb3-75b3a6af23bd None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.629512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28abbe8-8cd9-49be-beb3-75b3a6af23bd None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.629736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28abbe8-8cd9-49be-beb3-75b3a6af23bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.652862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 773/1544] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:27.655989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-f28abbe8-8cd9-49be-beb3-75b3a6af23bd None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.655989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f28abbe8-8cd9-49be-beb3-75b3a6af23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.657632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57d0e-c8d4-42e6-b268-60112734ed5c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.658136 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57d0e-c8d4-42e6-b268-60112734ed5c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.658616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca57d0e-c8d4-42e6-b268-60112734ed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.668242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 772/1545] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:42:27.669337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28abbe8-8cd9-49be-beb3-75b3a6af23bd None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.688125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28abbe8-8cd9-49be-beb3-75b3a6af23bd None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.689937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52e942-357f-420a-82e0-319f1af51d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.692010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52e942-357f-420a-82e0-319f1af51d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.692010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52e942-357f-420a-82e0-319f1af51d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.693702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52e942-357f-420a-82e0-319f1af51d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.694033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-eca57d0e-c8d4-42e6-b268-60112734ed5c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.694389 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52e942-357f-420a-82e0-319f1af51d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.695739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-eca57d0e-c8d4-42e6-b268-60112734ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.696105 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52e942-357f-420a-82e0-319f1af51d64 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.710118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 773/1546] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:27.711898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e0dd-a8cc-4eeb-8ba9-347478338ea2 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.712192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e0dd-a8cc-4eeb-8ba9-347478338ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.712471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e0dd-a8cc-4eeb-8ba9-347478338ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.713746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 774/1547] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.715239 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ecdbc-96fd-47b8-b98c-f0ff716b3f2c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.715758 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ecdbc-96fd-47b8-b98c-f0ff716b3f2c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.725426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ecdbc-96fd-47b8-b98c-f0ff716b3f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.737655 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-4a75e0dd-a8cc-4eeb-8ba9-347478338ea2 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.738866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4a75e0dd-a8cc-4eeb-8ba9-347478338ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.747392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 774/1548] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.748399 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75e0dd-a8cc-4eeb-8ba9-347478338ea2 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.754105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f31ecdbc-96fd-47b8-b98c-f0ff716b3f2c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.756205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f31ecdbc-96fd-47b8-b98c-f0ff716b3f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.759320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75e0dd-a8cc-4eeb-8ba9-347478338ea2 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.765381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521419b4-7550-43db-987b-0454e55afeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.765934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521419b4-7550-43db-987b-0454e55afeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.766215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521419b4-7550-43db-987b-0454e55afeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.766486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521419b4-7550-43db-987b-0454e55afeb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.766912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 775/1549] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.767186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521419b4-7550-43db-987b-0454e55afeb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.768681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e19d7-d962-41fa-b879-e5794f045720 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.769183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e19d7-d962-41fa-b879-e5794f045720 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.769677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e19d7-d962-41fa-b879-e5794f045720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.772610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521419b4-7550-43db-987b-0454e55afeb4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.785411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 775/1550] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:27.786702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d610-e0c8-4488-ba27-698ca233d243 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.786987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d610-e0c8-4488-ba27-698ca233d243 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.787263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d610-e0c8-4488-ba27-698ca233d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.803896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-e80e19d7-d962-41fa-b879-e5794f045720 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.805574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e80e19d7-d962-41fa-b879-e5794f045720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.810839 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7af3d610-e0c8-4488-ba27-698ca233d243 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.812181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7af3d610-e0c8-4488-ba27-698ca233d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.819530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 776/1551] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.820693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e19d7-d962-41fa-b879-e5794f045720 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.821150 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 776/1552] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.821946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3d610-e0c8-4488-ba27-698ca233d243 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.833127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e19d7-d962-41fa-b879-e5794f045720 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.836404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3d610-e0c8-4488-ba27-698ca233d243 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.838850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7254f7-68f6-4ed9-9deb-d9516c7b0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.839922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7254f7-68f6-4ed9-9deb-d9516c7b0ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.840446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7254f7-68f6-4ed9-9deb-d9516c7b0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.840930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7254f7-68f6-4ed9-9deb-d9516c7b0ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.841606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674953f0-617d-48d7-937f-77c052a440f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.842030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7254f7-68f6-4ed9-9deb-d9516c7b0ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:27.842279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674953f0-617d-48d7-937f-77c052a440f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.842550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674953f0-617d-48d7-937f-77c052a440f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.842813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7254f7-68f6-4ed9-9deb-d9516c7b0ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.842941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674953f0-617d-48d7-937f-77c052a440f2 admin admin] PATH_INFO: `/v3/projects/2af35cdeefd943caabc8d93bab363c5c/users/074e13c753f047968b2560b12d4b53a4/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.844471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7254f7-68f6-4ed9-9deb-d9516c7b0ba3 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.856444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 777/1553] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:27.857765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60603f-fa96-4d74-9be8-f0110fc3799e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.857983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674953f0-617d-48d7-937f-77c052a440f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af35cdeefd943caabc8d93bab363c5c, user_id=074e13c753f047968b2560b12d4b53a4, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.858105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60603f-fa96-4d74-9be8-f0110fc3799e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.858375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60603f-fa96-4d74-9be8-f0110fc3799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.860631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674953f0-617d-48d7-937f-77c052a440f2 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.879493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 777/1554] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:27 2022] PUT /identity/v3/projects/2af35cdeefd943caabc8d93bab363c5c/users/074e13c753f047968b2560b12d4b53a4/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:27.879493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1aba6-2968-4e77-9c87-f125adb9e8cf None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.879493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1aba6-2968-4e77-9c87-f125adb9e8cf None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.879493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1aba6-2968-4e77-9c87-f125adb9e8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.879939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-2f60603f-fa96-4d74-9be8-f0110fc3799e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.880233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2f60603f-fa96-4d74-9be8-f0110fc3799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.898243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-eee1aba6-2968-4e77-9c87-f125adb9e8cf None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:27.899627 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-eee1aba6-2968-4e77-9c87-f125adb9e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:27.941862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 778/1555] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.949132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60603f-fa96-4d74-9be8-f0110fc3799e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.959240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60603f-fa96-4d74-9be8-f0110fc3799e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.963367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 778/1556] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:27.964301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e130c4f-11cc-4991-83da-dcc597437fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.964443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1aba6-2968-4e77-9c87-f125adb9e8cf None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:27.964923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e130c4f-11cc-4991-83da-dcc597437fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.965207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e130c4f-11cc-4991-83da-dcc597437fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.965486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e130c4f-11cc-4991-83da-dcc597437fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.966167 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e130c4f-11cc-4991-83da-dcc597437fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:27.966477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e130c4f-11cc-4991-83da-dcc597437fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.968143 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e130c4f-11cc-4991-83da-dcc597437fbd admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.974070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1aba6-2968-4e77-9c87-f125adb9e8cf None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:27.978853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261df3c-dc10-465d-908b-31c1c8d21534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:27.979454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261df3c-dc10-465d-908b-31c1c8d21534 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.979735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261df3c-dc10-465d-908b-31c1c8d21534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.980047 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261df3c-dc10-465d-908b-31c1c8d21534 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.980193 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 779/1557] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:27.980693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261df3c-dc10-465d-908b-31c1c8d21534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:27.980993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261df3c-dc10-465d-908b-31c1c8d21534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:27.981374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0427e3-df3f-4650-b1ef-03c0570cce07 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.981663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0427e3-df3f-4650-b1ef-03c0570cce07 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:27.981939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0427e3-df3f-4650-b1ef-03c0570cce07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:27.982053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING py.warnings [None req-8261df3c-dc10-465d-908b-31c1c8d21534 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:42:27.982053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: warnings.warn(msg) Sep 01 15:42:27.982053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: Sep 01 15:42:27.982871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261df3c-dc10-465d-908b-31c1c8d21534 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:27.998496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 779/1558] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:27.999639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1a06-cd16-465c-b2ca-c1d5a79569dd None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:27.999944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1a06-cd16-465c-b2ca-c1d5a79569dd None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.000218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1a06-cd16-465c-b2ca-c1d5a79569dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.006384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-1c0427e3-df3f-4650-b1ef-03c0570cce07 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:28.007635 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1c0427e3-df3f-4650-b1ef-03c0570cce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:28.016795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 780/1559] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:28.017490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0427e3-df3f-4650-b1ef-03c0570cce07 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.020297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-abba1a06-cd16-465c-b2ca-c1d5a79569dd None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:28.021481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-abba1a06-cd16-465c-b2ca-c1d5a79569dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:28.026974 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0427e3-df3f-4650-b1ef-03c0570cce07 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.029737 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 780/1560] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:28.030916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c6a7-01d6-472e-82ab-5551c07492b1 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.031201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c6a7-01d6-472e-82ab-5551c07492b1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.031476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c6a7-01d6-472e-82ab-5551c07492b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.032496 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7018a-69a6-46d1-90a4-a3478123983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.033094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7018a-69a6-46d1-90a4-a3478123983d admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.033377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7018a-69a6-46d1-90a4-a3478123983d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.033650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7018a-69a6-46d1-90a4-a3478123983d admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.034277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7018a-69a6-46d1-90a4-a3478123983d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.035303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING py.warnings [None req-d9e7018a-69a6-46d1-90a4-a3478123983d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:42:28.035303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: warnings.warn(msg) Sep 01 15:42:28.035303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: Sep 01 15:42:28.036677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7018a-69a6-46d1-90a4-a3478123983d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.049669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-bec2c6a7-01d6-472e-82ab-5551c07492b1 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:28.050853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bec2c6a7-01d6-472e-82ab-5551c07492b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:28.052129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:28.059906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 781/1561] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:28.061295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64dd3-964a-430a-93bc-0ef45ee44241 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.061586 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64dd3-964a-430a-93bc-0ef45ee44241 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.061863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e64dd3-964a-430a-93bc-0ef45ee44241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.069851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 781/1562] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.071108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c814-8550-4353-a2ab-7ed8fc3a1524 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.071392 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c814-8550-4353-a2ab-7ed8fc3a1524 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.071665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c814-8550-4353-a2ab-7ed8fc3a1524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.085705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d7e64dd3-964a-430a-93bc-0ef45ee44241 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:28.086909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d7e64dd3-964a-430a-93bc-0ef45ee44241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:28.091940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-7787c814-8550-4353-a2ab-7ed8fc3a1524 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:28.093139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7787c814-8550-4353-a2ab-7ed8fc3a1524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:28.114244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:28.150660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 782/1563] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:28.151871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e64dd3-964a-430a-93bc-0ef45ee44241 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.152175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 782/1564] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:28.152985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c814-8550-4353-a2ab-7ed8fc3a1524 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.163245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c814-8550-4353-a2ab-7ed8fc3a1524 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.163949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e64dd3-964a-430a-93bc-0ef45ee44241 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.168410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db52a-39c9-422b-8e7e-8ec4b96b646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.169011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db52a-39c9-422b-8e7e-8ec4b96b646a admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.169289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db52a-39c9-422b-8e7e-8ec4b96b646a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.169398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a82da2-54e6-436d-bf24-790bb7b6be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.169576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db52a-39c9-422b-8e7e-8ec4b96b646a admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.170072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82da2-54e6-436d-bf24-790bb7b6be05 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.170204 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db52a-39c9-422b-8e7e-8ec4b96b646a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.170387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82da2-54e6-436d-bf24-790bb7b6be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.170665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82da2-54e6-436d-bf24-790bb7b6be05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.171295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a82da2-54e6-436d-bf24-790bb7b6be05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.172118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db52a-39c9-422b-8e7e-8ec4b96b646a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.173225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a82da2-54e6-436d-bf24-790bb7b6be05 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.201279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 783/1565] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.201678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 783/1566] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.202545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03551f-ccaa-49d6-986c-5ef69706f749 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.202837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03551f-ccaa-49d6-986c-5ef69706f749 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.203113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03551f-ccaa-49d6-986c-5ef69706f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.203238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d3ff-6f7c-43e9-bf91-1d5f94a59a2b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.203403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d3ff-6f7c-43e9-bf91-1d5f94a59a2b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.203671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1d3ff-6f7c-43e9-bf91-1d5f94a59a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.222008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ad03551f-ccaa-49d6-986c-5ef69706f749 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:28.222316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d7c1d3ff-6f7c-43e9-bf91-1d5f94a59a2b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:28.223215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ad03551f-ccaa-49d6-986c-5ef69706f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:28.223471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d7c1d3ff-6f7c-43e9-bf91-1d5f94a59a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:28.281965 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 784/1567] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:28.282266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 784/1568] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:28.283011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03551f-ccaa-49d6-986c-5ef69706f749 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.284732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d3ff-6f7c-43e9-bf91-1d5f94a59a2b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.295356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03551f-ccaa-49d6-986c-5ef69706f749 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.300000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de252dc-1de2-42ca-b97c-78eaa24764ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.300606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de252dc-1de2-42ca-b97c-78eaa24764ed admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.300888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de252dc-1de2-42ca-b97c-78eaa24764ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.301160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de252dc-1de2-42ca-b97c-78eaa24764ed admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.301815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de252dc-1de2-42ca-b97c-78eaa24764ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.303879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de252dc-1de2-42ca-b97c-78eaa24764ed admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.329155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 785/1569] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.329155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de252dc-1de2-42ca-b97c-78eaa24764ed admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.336670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de252dc-1de2-42ca-b97c-78eaa24764ed admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.341382 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.341971 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.342250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.342532 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.343164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:28.343464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.345105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.345417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1d3ff-6f7c-43e9-bf91-1d5f94a59a2b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.349171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975337ff-4c71-4ff3-b2b8-b5ddb1a16997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.349779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975337ff-4c71-4ff3-b2b8-b5ddb1a16997 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.350059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975337ff-4c71-4ff3-b2b8-b5ddb1a16997 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.350332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975337ff-4c71-4ff3-b2b8-b5ddb1a16997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.357430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 786/1570] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:28.358394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.360600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975337ff-4c71-4ff3-b2b8-b5ddb1a16997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.362024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975337ff-4c71-4ff3-b2b8-b5ddb1a16997 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.370181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb7ca4-5170-4a1d-8e0d-1e1f7e9d9fb9 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.372204 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 785/1571] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:28.372983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975337ff-4c71-4ff3-b2b8-b5ddb1a16997 service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.374935 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.375518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.375822 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.376101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.376730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:28.377038 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.378620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.382617 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975337ff-4c71-4ff3-b2b8-b5ddb1a16997 service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.388848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.389661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.390095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.390508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.390629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 787/1572] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:28.391329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.391562 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.392747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING py.warnings [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:42:28.392747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: warnings.warn(msg) Sep 01 15:42:28.392747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: Sep 01 15:42:28.394237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.410181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa186c3-b94c-4134-b56b-4e480ee1a3ec admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.415161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274081ec-604f-4678-a015-05247ee05526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.415896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274081ec-604f-4678-a015-05247ee05526 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.417150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274081ec-604f-4678-a015-05247ee05526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.417150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274081ec-604f-4678-a015-05247ee05526 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.417643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274081ec-604f-4678-a015-05247ee05526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.419648 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274081ec-604f-4678-a015-05247ee05526 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.423101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 786/1573] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.424032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.436275 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc21e1-6baa-4cf7-b386-6620ceca03d3 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.441922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.442185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.442515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.442689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.443737 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:28.444098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.447902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 788/1574] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/users => generated 302 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.448085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.448189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274081ec-604f-4678-a015-05247ee05526 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.460688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274081ec-604f-4678-a015-05247ee05526 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.461101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 787/1575] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:28.462166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.467796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.468424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.468705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.469559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.470193 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:28.470659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.472446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.473004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a2ad2-8ad4-4df3-aa7b-83b2014eea92 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.478519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819cbf8-7966-45bf-8413-8fe6ef8ebc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.479666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819cbf8-7966-45bf-8413-8fe6ef8ebc8c admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.479982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819cbf8-7966-45bf-8413-8fe6ef8ebc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.480260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819cbf8-7966-45bf-8413-8fe6ef8ebc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.480911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819cbf8-7966-45bf-8413-8fe6ef8ebc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.482508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819cbf8-7966-45bf-8413-8fe6ef8ebc8c admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.485189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:28.489834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 789/1576] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:28.491039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.497270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 788/1577] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:28.497270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819cbf8-7966-45bf-8413-8fe6ef8ebc8c admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.507232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819cbf8-7966-45bf-8413-8fe6ef8ebc8c admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.509516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764465fc-1a4c-4629-a75a-60722622bcd0 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.512923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077285b-77e3-489c-a38a-4d36238f3ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.513609 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077285b-77e3-489c-a38a-4d36238f3ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.513971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077285b-77e3-489c-a38a-4d36238f3ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.514345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077285b-77e3-489c-a38a-4d36238f3ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.514472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81de8-1144-471f-9f26-be958d0a8fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.514965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81de8-1144-471f-9f26-be958d0a8fab admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.515077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077285b-77e3-489c-a38a-4d36238f3ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.515251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81de8-1144-471f-9f26-be958d0a8fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.515522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de81de8-1144-471f-9f26-be958d0a8fab admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.516285 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de81de8-1144-471f-9f26-be958d0a8fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.517485 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077285b-77e3-489c-a38a-4d36238f3ce1 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.518440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de81de8-1144-471f-9f26-be958d0a8fab admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.530792 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:28.551599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 789/1578] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.553170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077285b-77e3-489c-a38a-4d36238f3ce1 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.556927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 790/1579] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.556927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81de8-1144-471f-9f26-be958d0a8fab admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.630507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de81de8-1144-471f-9f26-be958d0a8fab admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.630988 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077285b-77e3-489c-a38a-4d36238f3ce1 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.636500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ba05-7c92-42df-b81c-9b20871bf817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.636627 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584190f2-bb32-43ca-8582-4e7e1d7e8e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.637128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ba05-7c92-42df-b81c-9b20871bf817 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.637395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584190f2-bb32-43ca-8582-4e7e1d7e8e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.637516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ba05-7c92-42df-b81c-9b20871bf817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.637669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9ba05-7c92-42df-b81c-9b20871bf817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.637762 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584190f2-bb32-43ca-8582-4e7e1d7e8e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.638108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584190f2-bb32-43ca-8582-4e7e1d7e8e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.638316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ba05-7c92-42df-b81c-9b20871bf817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.638981 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584190f2-bb32-43ca-8582-4e7e1d7e8e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.639972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9ba05-7c92-42df-b81c-9b20871bf817 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.640908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584190f2-bb32-43ca-8582-4e7e1d7e8e63 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.652480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 790/1580] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:28.653189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584190f2-bb32-43ca-8582-4e7e1d7e8e63 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.659212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 791/1581] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:28.659212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ba05-7c92-42df-b81c-9b20871bf817 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.669722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584190f2-bb32-43ca-8582-4e7e1d7e8e63 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.669884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9ba05-7c92-42df-b81c-9b20871bf817 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.674686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ca493-afe0-4f93-a82d-3717537dcf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.675384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ca493-afe0-4f93-a82d-3717537dcf36 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.675736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ca493-afe0-4f93-a82d-3717537dcf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.676120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ca493-afe0-4f93-a82d-3717537dcf36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.676876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ca493-afe0-4f93-a82d-3717537dcf36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.677614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d8b4-ca1f-4cfb-817d-ea400ea8a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.678220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d8b4-ca1f-4cfb-817d-ea400ea8a4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.678498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d8b4-ca1f-4cfb-817d-ea400ea8a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.678772 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d8b4-ca1f-4cfb-817d-ea400ea8a4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.678904 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ca493-afe0-4f93-a82d-3717537dcf36 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.679406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572d8b4-ca1f-4cfb-817d-ea400ea8a4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.681031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572d8b4-ca1f-4cfb-817d-ea400ea8a4a6 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.691533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 792/1582] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:28.692333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d8b4-ca1f-4cfb-817d-ea400ea8a4a6 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.702740 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d8b4-ca1f-4cfb-817d-ea400ea8a4a6 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.709599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a7a3f-d051-4be9-84da-5badcc82df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.710281 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a7a3f-d051-4be9-84da-5badcc82df54 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.710627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a7a3f-d051-4be9-84da-5badcc82df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.710950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a7a3f-d051-4be9-84da-5badcc82df54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.711721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a7a3f-d051-4be9-84da-5badcc82df54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.713953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 791/1583] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.714444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a7a3f-d051-4be9-84da-5badcc82df54 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.715090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ca493-afe0-4f93-a82d-3717537dcf36 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.747192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 793/1584] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.747948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a7a3f-d051-4be9-84da-5badcc82df54 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.787659 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ca493-afe0-4f93-a82d-3717537dcf36 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.819645 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a7a3f-d051-4be9-84da-5badcc82df54 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.825504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab547-a877-4dfc-bd35-45bfde4fdc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.826135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab547-a877-4dfc-bd35-45bfde4fdc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.826418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab547-a877-4dfc-bd35-45bfde4fdc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.826695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab547-a877-4dfc-bd35-45bfde4fdc9a admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.827336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ab547-a877-4dfc-bd35-45bfde4fdc9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.829342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ab547-a877-4dfc-bd35-45bfde4fdc9a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.857695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 794/1585] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.857695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab547-a877-4dfc-bd35-45bfde4fdc9a admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.862577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13854a7b-743d-463f-996d-cad63f1da8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.862923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854a7b-743d-463f-996d-cad63f1da8bb admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.863201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854a7b-743d-463f-996d-cad63f1da8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.863480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854a7b-743d-463f-996d-cad63f1da8bb admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.864169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13854a7b-743d-463f-996d-cad63f1da8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.866058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13854a7b-743d-463f-996d-cad63f1da8bb admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.866595 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab547-a877-4dfc-bd35-45bfde4fdc9a admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.871982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8de4-b6af-43d1-bc81-c9eff5bdde47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.872594 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8de4-b6af-43d1-bc81-c9eff5bdde47 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.873008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8de4-b6af-43d1-bc81-c9eff5bdde47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.873315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b8de4-b6af-43d1-bc81-c9eff5bdde47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.873933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b8de4-b6af-43d1-bc81-c9eff5bdde47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.875639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b8de4-b6af-43d1-bc81-c9eff5bdde47 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.884292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:28.889356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 795/1586] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:28.893617 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8de4-b6af-43d1-bc81-c9eff5bdde47 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.894831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 792/1587] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.895925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13854a7b-743d-463f-996d-cad63f1da8bb admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.905969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b8de4-b6af-43d1-bc81-c9eff5bdde47 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.908605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13854a7b-743d-463f-996d-cad63f1da8bb admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.911535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be0127-237f-484d-baaf-ab64185ea555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.911849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be0127-237f-484d-baaf-ab64185ea555 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.912139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be0127-237f-484d-baaf-ab64185ea555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.912416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be0127-237f-484d-baaf-ab64185ea555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.913059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be0127-237f-484d-baaf-ab64185ea555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.914152 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95181db2-bde9-48e6-b77b-667f1a5b0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.914882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be0127-237f-484d-baaf-ab64185ea555 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.915031 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95181db2-bde9-48e6-b77b-667f1a5b0b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.915479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95181db2-bde9-48e6-b77b-667f1a5b0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.915882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95181db2-bde9-48e6-b77b-667f1a5b0b6a admin admin] PATH_INFO: `/v3/projects/66c940c520804b568eebd82cfd5a95fd/users/010c871c6afe475ebc260e85b736d407/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.928314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 796/1588] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:28.929672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be0127-237f-484d-baaf-ab64185ea555 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.936243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95181db2-bde9-48e6-b77b-667f1a5b0b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c940c520804b568eebd82cfd5a95fd, user_id=010c871c6afe475ebc260e85b736d407, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.939146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95181db2-bde9-48e6-b77b-667f1a5b0b6a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.941115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be0127-237f-484d-baaf-ab64185ea555 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:28.946391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a44ae5-ba55-4a46-b26b-830d1cd349eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:28.947125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a44ae5-ba55-4a46-b26b-830d1cd349eb admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:28.947952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a44ae5-ba55-4a46-b26b-830d1cd349eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:28.948342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a44ae5-ba55-4a46-b26b-830d1cd349eb admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:28.948945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a44ae5-ba55-4a46-b26b-830d1cd349eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:28.950963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a44ae5-ba55-4a46-b26b-830d1cd349eb admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:28.960419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:28.962604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 793/1589] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:28 2022] PUT /identity/v3/projects/66c940c520804b568eebd82cfd5a95fd/users/010c871c6afe475ebc260e85b736d407/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:28.964425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95181db2-bde9-48e6-b77b-667f1a5b0b6a admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.978168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 797/1590] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/users => generated 303 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:28.981818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a44ae5-ba55-4a46-b26b-830d1cd349eb admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:28.994530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a44ae5-ba55-4a46-b26b-830d1cd349eb admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.037747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95181db2-bde9-48e6-b77b-667f1a5b0b6a admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.042363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4eee-afab-40b3-b3ef-6a20ad741211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.043005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4eee-afab-40b3-b3ef-6a20ad741211 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.043942 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4eee-afab-40b3-b3ef-6a20ad741211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.043942 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4eee-afab-40b3-b3ef-6a20ad741211 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.044300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e4eee-afab-40b3-b3ef-6a20ad741211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.046131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e4eee-afab-40b3-b3ef-6a20ad741211 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.066873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b672155-e719-4d89-ac63-3c4d7a06805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.067601 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b672155-e719-4d89-ac63-3c4d7a06805f admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.067907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b672155-e719-4d89-ac63-3c4d7a06805f admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.068176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b672155-e719-4d89-ac63-3c4d7a06805f admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.068824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b672155-e719-4d89-ac63-3c4d7a06805f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.074241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b672155-e719-4d89-ac63-3c4d7a06805f admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.074395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 794/1591] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:28 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:29.074395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4eee-afab-40b3-b3ef-6a20ad741211 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.084933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 798/1592] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:29.084933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b672155-e719-4d89-ac63-3c4d7a06805f admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.085895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4eee-afab-40b3-b3ef-6a20ad741211 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.092827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0731de3-4b0d-4af6-b179-93892b59d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.093981 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731de3-4b0d-4af6-b179-93892b59d578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.094271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731de3-4b0d-4af6-b179-93892b59d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.094632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731de3-4b0d-4af6-b179-93892b59d578 admin admin] PATH_INFO: `/v3/projects/f0c2229ba61e4f778bde7ab6da7ab98b/users/b5a17c138b524db693ee97277e419a2f/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.095653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b672155-e719-4d89-ac63-3c4d7a06805f admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.101934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5997f17-0524-4003-8ded-7366f5cc601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.102537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5997f17-0524-4003-8ded-7366f5cc601d admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.102819 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5997f17-0524-4003-8ded-7366f5cc601d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.103088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5997f17-0524-4003-8ded-7366f5cc601d admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.103752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5997f17-0524-4003-8ded-7366f5cc601d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.105390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5997f17-0524-4003-8ded-7366f5cc601d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.113361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731de3-4b0d-4af6-b179-93892b59d578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c2229ba61e4f778bde7ab6da7ab98b, user_id=b5a17c138b524db693ee97277e419a2f, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.116159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731de3-4b0d-4af6-b179-93892b59d578 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.116661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 799/1593] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:29.117582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5997f17-0524-4003-8ded-7366f5cc601d admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.127753 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5997f17-0524-4003-8ded-7366f5cc601d admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.131316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 795/1594] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:29 2022] PUT /identity/v3/projects/f0c2229ba61e4f778bde7ab6da7ab98b/users/b5a17c138b524db693ee97277e419a2f/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:29.141607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71415eb-3a4a-417a-b865-947af31a7723 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.143284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71415eb-3a4a-417a-b865-947af31a7723 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.143898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71415eb-3a4a-417a-b865-947af31a7723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.177803 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c71415eb-3a4a-417a-b865-947af31a7723 None None] MFA Rules not processed for user `010c871c6afe475ebc260e85b736d407`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:29.180070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c71415eb-3a4a-417a-b865-947af31a7723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:29.199638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.200359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.200647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.201346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] PATH_INFO: `/v3/projects/f33a26e96e804081820ebfd24c32917a/users/74491e60ef3146b98f4ffcd0a730a122/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.221841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33a26e96e804081820ebfd24c32917a, user_id=74491e60ef3146b98f4ffcd0a730a122, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.222803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING py.warnings [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:42:29.222803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: warnings.warn(msg) Sep 01 15:42:29.222803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: Sep 01 15:42:29.224994 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.246578 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 800/1595] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:29 2022] PUT /identity/v3/projects/f33a26e96e804081820ebfd24c32917a/users/74491e60ef3146b98f4ffcd0a730a122/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:29.248436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.270999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 796/1596] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:29.271625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71415eb-3a4a-417a-b865-947af31a7723 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.284713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71415eb-3a4a-417a-b865-947af31a7723 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.330178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:29.340536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165622a-462e-46c9-993b-0776b8ec10b5 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.348043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b7ef6-2efc-4197-8f25-02d8b5e147c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.348870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b7ef6-2efc-4197-8f25-02d8b5e147c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.349154 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b7ef6-2efc-4197-8f25-02d8b5e147c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.349426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b7ef6-2efc-4197-8f25-02d8b5e147c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.350175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b7ef6-2efc-4197-8f25-02d8b5e147c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.351808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b7ef6-2efc-4197-8f25-02d8b5e147c2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.353519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:29.368021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 801/1597] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:29.368021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b7ef6-2efc-4197-8f25-02d8b5e147c2 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.371861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2cdbe-3ae9-4232-92e5-b83eaad716a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.372552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2cdbe-3ae9-4232-92e5-b83eaad716a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.373102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2cdbe-3ae9-4232-92e5-b83eaad716a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.373479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2cdbe-3ae9-4232-92e5-b83eaad716a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.374280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2cdbe-3ae9-4232-92e5-b83eaad716a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.376267 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2cdbe-3ae9-4232-92e5-b83eaad716a7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.378362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b7ef6-2efc-4197-8f25-02d8b5e147c2 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.383459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4965ddd-9a12-4ac7-9ee7-dcd189519fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.384183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965ddd-9a12-4ac7-9ee7-dcd189519fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.384530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965ddd-9a12-4ac7-9ee7-dcd189519fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.385508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4965ddd-9a12-4ac7-9ee7-dcd189519fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.386222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965ddd-9a12-4ac7-9ee7-dcd189519fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.387985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4965ddd-9a12-4ac7-9ee7-dcd189519fd1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.390678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 797/1598] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:29.391284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2cdbe-3ae9-4232-92e5-b83eaad716a7 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.402455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 802/1599] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:29.404171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfca38-a28c-443f-a580-0f4f292559ae None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.404606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfca38-a28c-443f-a580-0f4f292559ae None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.404892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfca38-a28c-443f-a580-0f4f292559ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.416147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2cdbe-3ae9-4232-92e5-b83eaad716a7 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.422100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befabab3-33bd-428f-aeb5-fe3a8256dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.422895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabab3-33bd-428f-aeb5-fe3a8256dad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.423091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabab3-33bd-428f-aeb5-fe3a8256dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.423492 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befabab3-33bd-428f-aeb5-fe3a8256dad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.424324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befabab3-33bd-428f-aeb5-fe3a8256dad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.426021 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befabab3-33bd-428f-aeb5-fe3a8256dad1 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.439895 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-67cfca38-a28c-443f-a580-0f4f292559ae None None] MFA Rules not processed for user `b5a17c138b524db693ee97277e419a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:29.441274 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-67cfca38-a28c-443f-a580-0f4f292559ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:29.441957 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 798/1600] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:29.443395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f720-c9bf-433b-ad55-508aab03dfa1 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.443686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f720-c9bf-433b-ad55-508aab03dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.444097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f720-c9bf-433b-ad55-508aab03dfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.478186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c971f720-c9bf-433b-ad55-508aab03dfa1 None None] MFA Rules not processed for user `74491e60ef3146b98f4ffcd0a730a122`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:29.479716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c971f720-c9bf-433b-ad55-508aab03dfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:29.546374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 803/1601] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:29.547812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfca38-a28c-443f-a580-0f4f292559ae None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.579384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 799/1602] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:29.583269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971f720-c9bf-433b-ad55-508aab03dfa1 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.596490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971f720-c9bf-433b-ad55-508aab03dfa1 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.604486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194b21-b95b-4f04-a283-479e099fe94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.605312 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194b21-b95b-4f04-a283-479e099fe94b admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.605573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194b21-b95b-4f04-a283-479e099fe94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.605991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194b21-b95b-4f04-a283-479e099fe94b admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.606941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01194b21-b95b-4f04-a283-479e099fe94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.609243 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01194b21-b95b-4f04-a283-479e099fe94b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.625970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 800/1603] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:29.626882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194b21-b95b-4f04-a283-479e099fe94b admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.637991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194b21-b95b-4f04-a283-479e099fe94b admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.642978 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f34d-5b4d-485c-950b-a37118297190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.643592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f34d-5b4d-485c-950b-a37118297190 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.643906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f34d-5b4d-485c-950b-a37118297190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.644184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f34d-5b4d-485c-950b-a37118297190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.644833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9f34d-5b4d-485c-950b-a37118297190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.647225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9f34d-5b4d-485c-950b-a37118297190 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.653336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfca38-a28c-443f-a580-0f4f292559ae None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.658504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708539fe-15ae-4039-9f10-30b1292fb119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.659533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708539fe-15ae-4039-9f10-30b1292fb119 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.659839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708539fe-15ae-4039-9f10-30b1292fb119 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.660165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708539fe-15ae-4039-9f10-30b1292fb119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.660641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 801/1604] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:29.662119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f34d-5b4d-485c-950b-a37118297190 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.674257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f34d-5b4d-485c-950b-a37118297190 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.685980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7da7e-902d-4a8b-89e5-0449fc3b0d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.686293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7da7e-902d-4a8b-89e5-0449fc3b0d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.686616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7da7e-902d-4a8b-89e5-0449fc3b0d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.686946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7da7e-902d-4a8b-89e5-0449fc3b0d06 admin admin] PATH_INFO: `/v3/projects/24ec4f3b2d77445b94ad43b64910b58a/users/4b533edbc818460485852b774b6cf477/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.707603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7da7e-902d-4a8b-89e5-0449fc3b0d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ec4f3b2d77445b94ad43b64910b58a, user_id=4b533edbc818460485852b774b6cf477, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.711359 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7da7e-902d-4a8b-89e5-0449fc3b0d06 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.735860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 802/1605] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:29 2022] PUT /identity/v3/projects/24ec4f3b2d77445b94ad43b64910b58a/users/4b533edbc818460485852b774b6cf477/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:29.738800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7da7e-902d-4a8b-89e5-0449fc3b0d06 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.752687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708539fe-15ae-4039-9f10-30b1292fb119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.754242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708539fe-15ae-4039-9f10-30b1292fb119 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.769345 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 804/1606] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:29.770969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eea74-f004-4504-a25d-8aaf412bca1b None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.771246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eea74-f004-4504-a25d-8aaf412bca1b None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.771557 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eea74-f004-4504-a25d-8aaf412bca1b None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.773026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 805/1607] 10.222.0.55 () {54 vars in 962 bytes} [Thu Sep 1 15:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:42:29.778970 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eea74-f004-4504-a25d-8aaf412bca1b None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.820972 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7da7e-902d-4a8b-89e5-0449fc3b0d06 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.821720 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:29.826307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbb68c-7fc0-43b3-86c2-ef10ce673e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.826987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbb68c-7fc0-43b3-86c2-ef10ce673e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.827269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbb68c-7fc0-43b3-86c2-ef10ce673e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.827547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbb68c-7fc0-43b3-86c2-ef10ce673e15 admin admin] PATH_INFO: `/v3/projects/e8490fae54e64656b7034bbeb40a5ab3/users/c0a97aa2248e465fa43e66fd74fb96d8/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.830568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:29.846190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbb68c-7fc0-43b3-86c2-ef10ce673e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8490fae54e64656b7034bbeb40a5ab3, user_id=c0a97aa2248e465fa43e66fd74fb96d8, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.849044 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbb68c-7fc0-43b3-86c2-ef10ce673e15 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.862611 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eea74-f004-4504-a25d-8aaf412bca1b None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.879171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 803/1608] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:29 2022] PUT /identity/v3/projects/e8490fae54e64656b7034bbeb40a5ab3/users/c0a97aa2248e465fa43e66fd74fb96d8/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:29.879171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbb68c-7fc0-43b3-86c2-ef10ce673e15 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:29.946597 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea36ca9-caed-48e8-997f-648b93bd6382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.947539 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea36ca9-caed-48e8-997f-648b93bd6382 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.958875 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea36ca9-caed-48e8-997f-648b93bd6382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.959229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea36ca9-caed-48e8-997f-648b93bd6382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:29.960046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea36ca9-caed-48e8-997f-648b93bd6382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:29.962338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea36ca9-caed-48e8-997f-648b93bd6382 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:29.978166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbb68c-7fc0-43b3-86c2-ef10ce673e15 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:29.986154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354082d-c280-4fd9-b407-feeef2a8b5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:29.986837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354082d-c280-4fd9-b407-feeef2a8b5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:29.987189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354082d-c280-4fd9-b407-feeef2a8b5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:29.987692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354082d-c280-4fd9-b407-feeef2a8b5d6 admin admin] PATH_INFO: `/v3/projects/a89bca1b38fa434c8b9d8a9715c92f9b/users/1e547c7d218b4a72bef620d1b47769b8/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.004997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 806/1609] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:29 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:30.010278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea36ca9-caed-48e8-997f-648b93bd6382 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:30.010450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354082d-c280-4fd9-b407-feeef2a8b5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89bca1b38fa434c8b9d8a9715c92f9b, user_id=1e547c7d218b4a72bef620d1b47769b8, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:30.013556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354082d-c280-4fd9-b407-feeef2a8b5d6 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:30.039516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 804/1610] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:29 2022] PUT /identity/v3/projects/a89bca1b38fa434c8b9d8a9715c92f9b/users/1e547c7d218b4a72bef620d1b47769b8/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:30.042265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cca15-52f7-4a03-97f7-dce3c723a026 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.042560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cca15-52f7-4a03-97f7-dce3c723a026 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.042838 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cca15-52f7-4a03-97f7-dce3c723a026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.083197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-6e1cca15-52f7-4a03-97f7-dce3c723a026 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:30.084551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6e1cca15-52f7-4a03-97f7-dce3c723a026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:30.120682 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea36ca9-caed-48e8-997f-648b93bd6382 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:30.196920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 805/1611] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:30.198098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ffe6-961c-407a-ae04-5758db154e2f None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.198385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ffe6-961c-407a-ae04-5758db154e2f None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.198669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ffe6-961c-407a-ae04-5758db154e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.262552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ae6b7-5320-488e-934b-721c520618d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:30.263611 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ae6b7-5320-488e-934b-721c520618d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.264164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ae6b7-5320-488e-934b-721c520618d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.264699 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ae6b7-5320-488e-934b-721c520618d2 admin admin] PATH_INFO: `/v3/projects/4a13c5270a4f4ba38234ce4fa7cb89d9/users/3c921ff0cbca40c7944ae3fb77cc96b9/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.281646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-aec0ffe6-961c-407a-ae04-5758db154e2f None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:30.282892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:30.283450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-aec0ffe6-961c-407a-ae04-5758db154e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:30.287645 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ae6b7-5320-488e-934b-721c520618d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a13c5270a4f4ba38234ce4fa7cb89d9, user_id=3c921ff0cbca40c7944ae3fb77cc96b9, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:30.291732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ae6b7-5320-488e-934b-721c520618d2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:30.324262 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 807/1612] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:30 2022] PUT /identity/v3/projects/4a13c5270a4f4ba38234ce4fa7cb89d9/users/3c921ff0cbca40c7944ae3fb77cc96b9/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:30.326015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982f117-cd9d-4667-9144-fbc5f08041c1 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.326355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982f117-cd9d-4667-9144-fbc5f08041c1 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.326707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982f117-cd9d-4667-9144-fbc5f08041c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.351899 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b982f117-cd9d-4667-9144-fbc5f08041c1 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:30.353050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b982f117-cd9d-4667-9144-fbc5f08041c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:30.361472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:30.412162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 806/1613] 10.222.0.55 () {58 vars in 1059 bytes} [Thu Sep 1 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:30.412936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ffe6-961c-407a-ae04-5758db154e2f None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:30.428411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ffe6-961c-407a-ae04-5758db154e2f None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:30.448280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 808/1614] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:30.448280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b30ba-8c01-4920-bf4b-ac8566eeecee None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.448280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b30ba-8c01-4920-bf4b-ac8566eeecee None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.448280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b30ba-8c01-4920-bf4b-ac8566eeecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.485443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b78b30ba-8c01-4920-bf4b-ac8566eeecee None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:30.489117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b78b30ba-8c01-4920-bf4b-ac8566eeecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:30.563831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 809/1615] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:30.563831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b30ba-8c01-4920-bf4b-ac8566eeecee None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:30.602312 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1e9d-8e72-434e-a1f5-b76305f01ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:30.604323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1e9d-8e72-434e-a1f5-b76305f01ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.604618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1e9d-8e72-434e-a1f5-b76305f01ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.604903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1e9d-8e72-434e-a1f5-b76305f01ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.607764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1e9d-8e72-434e-a1f5-b76305f01ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:30.609789 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1e9d-8e72-434e-a1f5-b76305f01ec2 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:30.648719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 807/1616] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:30 2022] POST /identity/v3/users => generated 309 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:30.650015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e8a58-6f78-44a6-b4ec-632d821fb9ac None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.650307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e8a58-6f78-44a6-b4ec-632d821fb9ac None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.651565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e8a58-6f78-44a6-b4ec-632d821fb9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.652114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b30ba-8c01-4920-bf4b-ac8566eeecee None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:30.657557 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f9961-5471-4187-91ec-218d045fe796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:30.658454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f9961-5471-4187-91ec-218d045fe796 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.658955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f9961-5471-4187-91ec-218d045fe796 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.659490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f9961-5471-4187-91ec-218d045fe796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.672597 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f9961-5471-4187-91ec-218d045fe796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:30.674441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f9961-5471-4187-91ec-218d045fe796 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:30.675395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-596e8a58-6f78-44a6-b4ec-632d821fb9ac None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:30.676694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-596e8a58-6f78-44a6-b4ec-632d821fb9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:30.690820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 808/1617] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:30.691749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e8a58-6f78-44a6-b4ec-632d821fb9ac None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:30.700699 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 810/1618] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:30.703894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f9961-5471-4187-91ec-218d045fe796 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:30.731926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f9961-5471-4187-91ec-218d045fe796 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:30.741578 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0af67-2a86-48b2-94e3-2dabae26291f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:30.743181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0af67-2a86-48b2-94e3-2dabae26291f service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.743553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0af67-2a86-48b2-94e3-2dabae26291f service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.743877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0af67-2a86-48b2-94e3-2dabae26291f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.770451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0af67-2a86-48b2-94e3-2dabae26291f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:30.772724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0af67-2a86-48b2-94e3-2dabae26291f service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:30.798593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 811/1619] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:30.799607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0af67-2a86-48b2-94e3-2dabae26291f service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:30.826721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0af67-2a86-48b2-94e3-2dabae26291f service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:30.834611 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1607976-adaf-4b50-ac16-6e5c9e702a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:30.835649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607976-adaf-4b50-ac16-6e5c9e702a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.836757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607976-adaf-4b50-ac16-6e5c9e702a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.838215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e8a58-6f78-44a6-b4ec-632d821fb9ac None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:30.838676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607976-adaf-4b50-ac16-6e5c9e702a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.852638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c6604-d75e-492d-93be-c5afbdbd531c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:30.853192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c6604-d75e-492d-93be-c5afbdbd531c service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.853473 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c6604-d75e-492d-93be-c5afbdbd531c service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.853806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c6604-d75e-492d-93be-c5afbdbd531c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.857309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1607976-adaf-4b50-ac16-6e5c9e702a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:30.858780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1607976-adaf-4b50-ac16-6e5c9e702a9a service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:30.881451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 812/1620] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:30.882330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1607976-adaf-4b50-ac16-6e5c9e702a9a service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:30.906596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1607976-adaf-4b50-ac16-6e5c9e702a9a service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:30.916774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a48efb-857a-4339-b73c-696dece2ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:30.917627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a48efb-857a-4339-b73c-696dece2ae4c admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.917920 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a48efb-857a-4339-b73c-696dece2ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.918194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a48efb-857a-4339-b73c-696dece2ae4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:30.918866 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a48efb-857a-4339-b73c-696dece2ae4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:30.924655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a48efb-857a-4339-b73c-696dece2ae4c admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:30.957561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 813/1621] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:30.960059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a48efb-857a-4339-b73c-696dece2ae4c admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:30.981511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a48efb-857a-4339-b73c-696dece2ae4c admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:30.983023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c6604-d75e-492d-93be-c5afbdbd531c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:30.984534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c6604-d75e-492d-93be-c5afbdbd531c service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:30.993180 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae08c-a915-486f-ae77-aa016fa0bbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:30.993812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae08c-a915-486f-ae77-aa016fa0bbcc service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:30.994094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae08c-a915-486f-ae77-aa016fa0bbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:30.994885 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae08c-a915-486f-ae77-aa016fa0bbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.004556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 809/1622] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:31.005009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c6604-d75e-492d-93be-c5afbdbd531c service nova] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:31.011763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae08c-a915-486f-ae77-aa016fa0bbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:31.013252 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae08c-a915-486f-ae77-aa016fa0bbcc service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:31.016085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:31.021872 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c6604-d75e-492d-93be-c5afbdbd531c service nova] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:31.027867 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 814/1623] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:31.032822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80476bd-581c-4e1d-b8d5-d804a75d7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:31.033820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80476bd-581c-4e1d-b8d5-d804a75d7396 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:31.034373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80476bd-581c-4e1d-b8d5-d804a75d7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:31.034851 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80476bd-581c-4e1d-b8d5-d804a75d7396 admin admin] PATH_INFO: `/v3/projects/dcac6a6710834a568206612fd92c6985/users/1c92e7203cc64464aad6334acb6743d4/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.058771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80476bd-581c-4e1d-b8d5-d804a75d7396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcac6a6710834a568206612fd92c6985, user_id=1c92e7203cc64464aad6334acb6743d4, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:31.062668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80476bd-581c-4e1d-b8d5-d804a75d7396 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:31.087914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 810/1624] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:31 2022] PUT /identity/v3/projects/dcac6a6710834a568206612fd92c6985/users/1c92e7203cc64464aad6334acb6743d4/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:31.092339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae08c-a915-486f-ae77-aa016fa0bbcc service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:31.104674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae08c-a915-486f-ae77-aa016fa0bbcc service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:31.170331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:31.206512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb9335-4408-42e9-bc41-bd3a48514826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:31.213446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9335-4408-42e9-bc41-bd3a48514826 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:31.213777 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9335-4408-42e9-bc41-bd3a48514826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:31.214056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9335-4408-42e9-bc41-bd3a48514826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.214769 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9335-4408-42e9-bc41-bd3a48514826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:31.216504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9335-4408-42e9-bc41-bd3a48514826 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:31.244800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 815/1625] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:31.248949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80476bd-581c-4e1d-b8d5-d804a75d7396 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:31.263873 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80476bd-581c-4e1d-b8d5-d804a75d7396 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:31.277423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5c511-0903-4f7c-bd9e-825d0d08a1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:31.278189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5c511-0903-4f7c-bd9e-825d0d08a1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:31.278608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5c511-0903-4f7c-bd9e-825d0d08a1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:31.279226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5c511-0903-4f7c-bd9e-825d0d08a1f3 admin admin] PATH_INFO: `/v3/projects/dcac6a6710834a568206612fd92c6985/users/1c92e7203cc64464aad6334acb6743d4/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.282438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5c511-0903-4f7c-bd9e-825d0d08a1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcac6a6710834a568206612fd92c6985, user_id=1c92e7203cc64464aad6334acb6743d4, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:31.287870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5c511-0903-4f7c-bd9e-825d0d08a1f3 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:31.315110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 811/1626] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:31 2022] PUT /identity/v3/projects/dcac6a6710834a568206612fd92c6985/users/1c92e7203cc64464aad6334acb6743d4/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:42:31.323788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d8f4-74ca-464e-9bce-fbaaa73837d2 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:31.324099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d8f4-74ca-464e-9bce-fbaaa73837d2 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:31.324907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177d8f4-74ca-464e-9bce-fbaaa73837d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.355430 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-e177d8f4-74ca-464e-9bce-fbaaa73837d2 None None] MFA Rules not processed for user `1c92e7203cc64464aad6334acb6743d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:31.356680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e177d8f4-74ca-464e-9bce-fbaaa73837d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:31.364309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5e74-41c5-4b14-9e67-eea8676e8dce None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:31.364578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5e74-41c5-4b14-9e67-eea8676e8dce None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:31.364840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad5e74-41c5-4b14-9e67-eea8676e8dce None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.366392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 812/1627] 10.222.0.55 () {54 vars in 912 bytes} [Thu Sep 1 15:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 15:42:31.377643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032bfc-31f0-445e-98c3-b01d13614401 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:31.378141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032bfc-31f0-445e-98c3-b01d13614401 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:31.378748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28032bfc-31f0-445e-98c3-b01d13614401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.420350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-28032bfc-31f0-445e-98c3-b01d13614401 None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:31.422273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-28032bfc-31f0-445e-98c3-b01d13614401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:31.469968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 816/1628] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:31.471742 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177d8f4-74ca-464e-9bce-fbaaa73837d2 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:31.556226 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177d8f4-74ca-464e-9bce-fbaaa73837d2 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:31.561502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07fb3-1321-44b4-a818-aa50b1e106e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:31.562142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07fb3-1321-44b4-a818-aa50b1e106e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:31.562589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07fb3-1321-44b4-a818-aa50b1e106e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:31.562870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07fb3-1321-44b4-a818-aa50b1e106e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.587750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef07fb3-1321-44b4-a818-aa50b1e106e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:31.589404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef07fb3-1321-44b4-a818-aa50b1e106e9 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:31.592516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 813/1629] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:42:31.605756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032bfc-31f0-445e-98c3-b01d13614401 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:31.624402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 817/1630] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:31 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:31.631202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28032bfc-31f0-445e-98c3-b01d13614401 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:31.637903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4020a2-f674-4adb-a309-b48ecbd8e6cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:31.639013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4020a2-f674-4adb-a309-b48ecbd8e6cd service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:31.639013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4020a2-f674-4adb-a309-b48ecbd8e6cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:31.639222 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4020a2-f674-4adb-a309-b48ecbd8e6cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:31.652954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4020a2-f674-4adb-a309-b48ecbd8e6cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:31.664071 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4020a2-f674-4adb-a309-b48ecbd8e6cd service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:31.692308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 814/1631] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:31.890141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07fb3-1321-44b4-a818-aa50b1e106e9 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:32.080409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07fb3-1321-44b4-a818-aa50b1e106e9 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:32.093329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:32.093891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:32.098843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:32.099141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] PATH_INFO: `/v3/users/74491e60ef3146b98f4ffcd0a730a122` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:32.100470 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74491e60ef3146b98f4ffcd0a730a122)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:32.105320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: WARNING py.warnings [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:42:32.105320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: warnings.warn(msg) Sep 01 15:42:32.105320 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: Sep 01 15:42:32.106635 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:32.113238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:32.316954 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74491e60ef3146b98f4ffcd0a730a122'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:32.317706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74491e60ef3146b98f4ffcd0a730a122'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:32.345985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74491e60ef3146b98f4ffcd0a730a122'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:32.353079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74491e60ef3146b98f4ffcd0a730a122'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:32.371047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-af6a1aeb-c7cf-49ee-84a8-1dce904149b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74491e60ef3146b98f4ffcd0a730a122'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:32.426712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 818/1632] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:31 2022] DELETE /identity/v3/users/74491e60ef3146b98f4ffcd0a730a122 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:32.429032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2211b40-ca5c-4012-a7dd-e5d9cf7aea47 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:32.429557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2211b40-ca5c-4012-a7dd-e5d9cf7aea47 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:32.429768 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2211b40-ca5c-4012-a7dd-e5d9cf7aea47 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:32.431608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 815/1633] 10.222.0.55 () {54 vars in 962 bytes} [Thu Sep 1 15:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:42:32.433344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0dd2e-35ad-4a51-9c0d-df3df898106f None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:32.433804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0dd2e-35ad-4a51-9c0d-df3df898106f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:32.434093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0dd2e-35ad-4a51-9c0d-df3df898106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:32.440404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535dbe-f5f5-4afe-868b-fa0d1e6cee9d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:32.440689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535dbe-f5f5-4afe-868b-fa0d1e6cee9d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:32.441266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535dbe-f5f5-4afe-868b-fa0d1e6cee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:32.468278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3da0dd2e-35ad-4a51-9c0d-df3df898106f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:32.469903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3da0dd2e-35ad-4a51-9c0d-df3df898106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:32.487868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-35535dbe-f5f5-4afe-868b-fa0d1e6cee9d None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:32.489116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-35535dbe-f5f5-4afe-868b-fa0d1e6cee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:32.619924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 819/1634] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:32.647310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0dd2e-35ad-4a51-9c0d-df3df898106f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:32.648714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3da0dd2e-35ad-4a51-9c0d-df3df898106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:32.754938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 816/1635] 10.222.0.55 () {58 vars in 1059 bytes} [Thu Sep 1 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:42:32.757436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf231-2785-42b6-97d4-1c5cc00f3a3d None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:32.757984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf231-2785-42b6-97d4-1c5cc00f3a3d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:32.758264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf231-2785-42b6-97d4-1c5cc00f3a3d None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:32.768546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 817/1636] 10.222.0.55 () {54 vars in 912 bytes} [Thu Sep 1 15:42:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:42:32.770147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8d1fa-2bb7-4a05-892c-8408741c79a9 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:32.773350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8d1fa-2bb7-4a05-892c-8408741c79a9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:32.773907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8d1fa-2bb7-4a05-892c-8408741c79a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:32.813550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0dd2e-35ad-4a51-9c0d-df3df898106f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:32.824694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:32.825337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:32.825668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:32.825944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:32.848780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:32.852467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:32.860309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-29b8d1fa-2bb7-4a05-892c-8408741c79a9 None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:32.861795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-29b8d1fa-2bb7-4a05-892c-8408741c79a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:32.877844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 820/1637] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:42:32.904662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:32.904891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 818/1638] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:32.906443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:32.972795 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:33.054829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28d20-3ff8-4c0e-9a44-1289b0375b79 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:33.081866 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb14f4-7163-4c30-af85-55bbd049d369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:33.085528 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb14f4-7163-4c30-af85-55bbd049d369 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:33.087187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb14f4-7163-4c30-af85-55bbd049d369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:33.088066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb14f4-7163-4c30-af85-55bbd049d369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:33.130516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb14f4-7163-4c30-af85-55bbd049d369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:33.136690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb14f4-7163-4c30-af85-55bbd049d369 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:33.166483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 821/1639] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:34.913174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8d1fa-2bb7-4a05-892c-8408741c79a9 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:34.915211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-29b8d1fa-2bb7-4a05-892c-8408741c79a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:34.954219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8d1fa-2bb7-4a05-892c-8408741c79a9 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:34.972976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:34.977046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:34.977345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:34.977632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] PATH_INFO: `/v3/projects/f33a26e96e804081820ebfd24c32917a` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:34.983466 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33a26e96e804081820ebfd24c32917a)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:34.988626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: WARNING py.warnings [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 15:42:34.988626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: warnings.warn(msg) Sep 01 15:42:34.988626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: Sep 01 15:42:34.996554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:35.142880 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:35.194354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33a26e96e804081820ebfd24c32917a', 'request_id': 'req-271262f9-703f-40a6-97ce-53d7bdf2d8db'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.210598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33a26e96e804081820ebfd24c32917a', 'request_id': 'req-271262f9-703f-40a6-97ce-53d7bdf2d8db'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.226982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33a26e96e804081820ebfd24c32917a', 'request_id': 'req-271262f9-703f-40a6-97ce-53d7bdf2d8db'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.262539 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] The token cache is being invalidate because project f33a26e96e804081820ebfd24c32917a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:35.263007 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.264283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-271262f9-703f-40a6-97ce-53d7bdf2d8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.266321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 819/1640] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:34 2022] DELETE /identity/v3/projects/f33a26e96e804081820ebfd24c32917a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:35.274947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb14f4-7163-4c30-af85-55bbd049d369 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:35.291394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb14f4-7163-4c30-af85-55bbd049d369 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:35.488590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:35.489256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:35.489718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:35.490119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] PATH_INFO: `/v3/users/1c92e7203cc64464aad6334acb6743d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:35.493083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c92e7203cc64464aad6334acb6743d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:35.496073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:35.598877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c92e7203cc64464aad6334acb6743d4'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.599601 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c92e7203cc64464aad6334acb6743d4'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.620490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c92e7203cc64464aad6334acb6743d4'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.626096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c92e7203cc64464aad6334acb6743d4'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.640210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c92e7203cc64464aad6334acb6743d4'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:35.715065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 822/1641] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:35 2022] DELETE /identity/v3/users/1c92e7203cc64464aad6334acb6743d4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:36.458664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a7e3-54cb-46c2-8e21-7ec80a23aecd None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:36.459215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a7e3-54cb-46c2-8e21-7ec80a23aecd None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:36.459215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a7e3-54cb-46c2-8e21-7ec80a23aecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:36.500865 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3ed6a7e3-54cb-46c2-8e21-7ec80a23aecd None None] MFA Rules not processed for user `1e547c7d218b4a72bef620d1b47769b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:36.501878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3ed6a7e3-54cb-46c2-8e21-7ec80a23aecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:36.647521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 820/1642] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:36.652901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:36.654434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:36.763705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:36.796408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8a6e8-8a36-4477-a25b-80a1eead88e8 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:36.816294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82ee0-24cd-41a1-802b-45ff7c4b4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:36.818726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82ee0-24cd-41a1-802b-45ff7c4b4030 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:36.821808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82ee0-24cd-41a1-802b-45ff7c4b4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:36.823099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82ee0-24cd-41a1-802b-45ff7c4b4030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:36.824054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82ee0-24cd-41a1-802b-45ff7c4b4030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:36.830072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82ee0-24cd-41a1-802b-45ff7c4b4030 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:36.878966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 823/1643] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:36 2022] POST /identity/v3/projects => generated 403 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:36.882933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6a7e3-54cb-46c2-8e21-7ec80a23aecd None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:36.902907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6a7e3-54cb-46c2-8e21-7ec80a23aecd None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:37.053906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200350-5a2d-416a-8a0d-f9a30348e840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:37.056337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200350-5a2d-416a-8a0d-f9a30348e840 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:37.059181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200350-5a2d-416a-8a0d-f9a30348e840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:37.059629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200350-5a2d-416a-8a0d-f9a30348e840 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:37.063102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97200350-5a2d-416a-8a0d-f9a30348e840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:37.097626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97200350-5a2d-416a-8a0d-f9a30348e840 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:37.149551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 821/1644] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:36 2022] POST /identity/v3/users => generated 308 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:37.162711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82ee0-24cd-41a1-802b-45ff7c4b4030 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:37.183768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82ee0-24cd-41a1-802b-45ff7c4b4030 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:37.188723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb466-d8bc-453e-97e0-05a1ff86f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:37.189360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb466-d8bc-453e-97e0-05a1ff86f163 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:37.189813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb466-d8bc-453e-97e0-05a1ff86f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:37.190091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbb466-d8bc-453e-97e0-05a1ff86f163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:37.190752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbb466-d8bc-453e-97e0-05a1ff86f163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:37.208149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbb466-d8bc-453e-97e0-05a1ff86f163 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:37.248103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200350-5a2d-416a-8a0d-f9a30348e840 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:37.248543 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 824/1645] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:37.264449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200350-5a2d-416a-8a0d-f9a30348e840 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:37.270708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4440-2e73-442b-9807-e6191f37f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:37.271631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4440-2e73-442b-9807-e6191f37f301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:37.272157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4440-2e73-442b-9807-e6191f37f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:37.273103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4440-2e73-442b-9807-e6191f37f301 admin admin] PATH_INFO: `/v3/projects/09e39448e2cb4447a2db73234b3ffae1/users/b069142a9ae44602b9e5cd805ab5e0c4/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:37.296480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc4440-2e73-442b-9807-e6191f37f301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e39448e2cb4447a2db73234b3ffae1, user_id=b069142a9ae44602b9e5cd805ab5e0c4, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:37.300173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc4440-2e73-442b-9807-e6191f37f301 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:37.332928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb466-d8bc-453e-97e0-05a1ff86f163 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:37.333385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 822/1646] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:37 2022] PUT /identity/v3/projects/09e39448e2cb4447a2db73234b3ffae1/users/b069142a9ae44602b9e5cd805ab5e0c4/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:42:37.345519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbb466-d8bc-453e-97e0-05a1ff86f163 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:37.431455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:37.432712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:37.433000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:37.433292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:37.433961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:37.435713 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:37.456493 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 825/1647] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:37.458066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4440-2e73-442b-9807-e6191f37f301 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:37.479162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:37.481428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc4440-2e73-442b-9807-e6191f37f301 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:37.487997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:37.503282 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dafc9-f589-47ca-b1be-ca1b5c003fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:37.504526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dafc9-f589-47ca-b1be-ca1b5c003fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:37.506166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dafc9-f589-47ca-b1be-ca1b5c003fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:37.506928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dafc9-f589-47ca-b1be-ca1b5c003fdf admin admin] PATH_INFO: `/v3/projects/09e39448e2cb4447a2db73234b3ffae1/users/b069142a9ae44602b9e5cd805ab5e0c4/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:37.511951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dafc9-f589-47ca-b1be-ca1b5c003fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e39448e2cb4447a2db73234b3ffae1, user_id=b069142a9ae44602b9e5cd805ab5e0c4, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:37.519140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dafc9-f589-47ca-b1be-ca1b5c003fdf admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:37.529071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01829d06-a194-45d0-b547-e74f9193cf96 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:37.531281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:37.533859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:37.534608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:37.534849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:37.535143 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] PATH_INFO: `/v3/projects/dcac6a6710834a568206612fd92c6985` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:37.543659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcac6a6710834a568206612fd92c6985)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:37.545744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:37.548322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 823/1648] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:37 2022] PUT /identity/v3/projects/09e39448e2cb4447a2db73234b3ffae1/users/b069142a9ae44602b9e5cd805ab5e0c4/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:37.660746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcac6a6710834a568206612fd92c6985', 'request_id': 'req-6516aea6-ce4a-4731-a98a-f017c39d32d6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:37.678772 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcac6a6710834a568206612fd92c6985', 'request_id': 'req-6516aea6-ce4a-4731-a98a-f017c39d32d6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:37.689636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcac6a6710834a568206612fd92c6985', 'request_id': 'req-6516aea6-ce4a-4731-a98a-f017c39d32d6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:37.734216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] The token cache is being invalidate because project dcac6a6710834a568206612fd92c6985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:37.734715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:37.735673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6516aea6-ce4a-4731-a98a-f017c39d32d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:37.747380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 826/1649] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:37 2022] DELETE /identity/v3/projects/dcac6a6710834a568206612fd92c6985 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:42:37.748455 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555ef17-da22-4974-9f9d-45306662dcfd None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:37.748697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555ef17-da22-4974-9f9d-45306662dcfd None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:37.749088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555ef17-da22-4974-9f9d-45306662dcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:37.782133 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5555ef17-da22-4974-9f9d-45306662dcfd None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:37.784369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5555ef17-da22-4974-9f9d-45306662dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:37.882247 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 824/1650] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:37.883627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da18f-b5ac-4347-b1be-d4e8b1ea155e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:37.883945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da18f-b5ac-4347-b1be-d4e8b1ea155e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:37.884267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8da18f-b5ac-4347-b1be-d4e8b1ea155e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:37.933351 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-fe8da18f-b5ac-4347-b1be-d4e8b1ea155e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:37.937514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-fe8da18f-b5ac-4347-b1be-d4e8b1ea155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:37.966590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 827/1651] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:42:37.976410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555ef17-da22-4974-9f9d-45306662dcfd None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:38.001825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555ef17-da22-4974-9f9d-45306662dcfd None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:38.008533 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:38.010367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:38.011004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:38.011417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:38.012449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:38.013552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:38.016013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:38.058405 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 825/1652] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:38.058976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8da18f-b5ac-4347-b1be-d4e8b1ea155e None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:38.070941 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8da18f-b5ac-4347-b1be-d4e8b1ea155e None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:38.078417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d2b26-15d7-48f1-9ed8-a2dd64509016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:38.079373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d2b26-15d7-48f1-9ed8-a2dd64509016 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:38.079881 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d2b26-15d7-48f1-9ed8-a2dd64509016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:38.080387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d2b26-15d7-48f1-9ed8-a2dd64509016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:38.081196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d2b26-15d7-48f1-9ed8-a2dd64509016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:38.084308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d2b26-15d7-48f1-9ed8-a2dd64509016 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:38.137831 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 828/1653] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:38 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:42:38.139366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:38.152804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc43a1-0d71-46e2-838e-88558269dd1e admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:38.333916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d022-126b-4756-a88e-92fcd6dcc4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:38.335606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d022-126b-4756-a88e-92fcd6dcc4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:38.337424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d022-126b-4756-a88e-92fcd6dcc4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:38.338755 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d022-126b-4756-a88e-92fcd6dcc4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:38.341127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7d022-126b-4756-a88e-92fcd6dcc4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:38.355724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7d022-126b-4756-a88e-92fcd6dcc4e3 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:38.434741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 826/1654] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:38 2022] POST /identity/v3/users => generated 284 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:38.436718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d2b26-15d7-48f1-9ed8-a2dd64509016 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:38.454435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d2b26-15d7-48f1-9ed8-a2dd64509016 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:38.469306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76efabb-af86-4404-aeed-5836945526a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:38.472426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76efabb-af86-4404-aeed-5836945526a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:38.472797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76efabb-af86-4404-aeed-5836945526a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:38.473207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76efabb-af86-4404-aeed-5836945526a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:38.473969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76efabb-af86-4404-aeed-5836945526a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:38.475759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76efabb-af86-4404-aeed-5836945526a5 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:38.483876 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:38.496384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 829/1655] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:38.498470 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d022-126b-4756-a88e-92fcd6dcc4e3 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:38.520255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d022-126b-4756-a88e-92fcd6dcc4e3 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:38.530264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a2b12-c4f2-484c-b700-8794bf257702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:38.530906 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a2b12-c4f2-484c-b700-8794bf257702 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:38.531175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a2b12-c4f2-484c-b700-8794bf257702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:38.531457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a2b12-c4f2-484c-b700-8794bf257702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:38.532653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a2b12-c4f2-484c-b700-8794bf257702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:38.534508 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a2b12-c4f2-484c-b700-8794bf257702 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:38.553482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 827/1656] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:38.557641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76efabb-af86-4404-aeed-5836945526a5 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:38.577778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76efabb-af86-4404-aeed-5836945526a5 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:38.595495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a981f-1d49-4f11-a44f-4492aff6820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:38.596212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a981f-1d49-4f11-a44f-4492aff6820c admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:38.596495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a981f-1d49-4f11-a44f-4492aff6820c admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:38.596774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a981f-1d49-4f11-a44f-4492aff6820c admin admin] PATH_INFO: `/v3/projects/0943ca43e6764b3caf09e3cd2a020052/users/d8e8bf97668c4b71be1ffcbdb7280712/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:38.624965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a981f-1d49-4f11-a44f-4492aff6820c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0943ca43e6764b3caf09e3cd2a020052, user_id=d8e8bf97668c4b71be1ffcbdb7280712, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:38.627669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a981f-1d49-4f11-a44f-4492aff6820c admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:38.662780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 830/1657] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:38 2022] PUT /identity/v3/projects/0943ca43e6764b3caf09e3cd2a020052/users/d8e8bf97668c4b71be1ffcbdb7280712/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:38.675174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5cde3-eedb-4a26-9bb5-eb9f186754df None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:38.675764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5cde3-eedb-4a26-9bb5-eb9f186754df None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:38.676226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5cde3-eedb-4a26-9bb5-eb9f186754df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:38.753705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3bd5cde3-eedb-4a26-9bb5-eb9f186754df None None] MFA Rules not processed for user `d8e8bf97668c4b71be1ffcbdb7280712`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:38.755889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3bd5cde3-eedb-4a26-9bb5-eb9f186754df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:38.978056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:39.030882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 828/1658] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:39.032774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a981f-1d49-4f11-a44f-4492aff6820c admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:39.245251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a981f-1d49-4f11-a44f-4492aff6820c admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:39.254188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22887a7-f8cd-4fbe-bd34-3d0e21b7bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:39.255101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22887a7-f8cd-4fbe-bd34-3d0e21b7bfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:39.255805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22887a7-f8cd-4fbe-bd34-3d0e21b7bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:39.255917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22887a7-f8cd-4fbe-bd34-3d0e21b7bfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:39.258158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22887a7-f8cd-4fbe-bd34-3d0e21b7bfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:39.261625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22887a7-f8cd-4fbe-bd34-3d0e21b7bfa1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:39.300855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 831/1659] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:39 2022] POST /identity/v3/projects => generated 367 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:39.301023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5cde3-eedb-4a26-9bb5-eb9f186754df None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:39.321704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5cde3-eedb-4a26-9bb5-eb9f186754df None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:39.460391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889dde-920c-4935-bc0d-d5c6af873632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:39.461264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889dde-920c-4935-bc0d-d5c6af873632 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:39.461691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889dde-920c-4935-bc0d-d5c6af873632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:39.462748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889dde-920c-4935-bc0d-d5c6af873632 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:39.463548 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889dde-920c-4935-bc0d-d5c6af873632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:39.474360 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889dde-920c-4935-bc0d-d5c6af873632 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:39.511624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 829/1660] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:39 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:42:39.516841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22887a7-f8cd-4fbe-bd34-3d0e21b7bfa1 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:39.540053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22887a7-f8cd-4fbe-bd34-3d0e21b7bfa1 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:39.548612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309cb5-5201-42dd-a730-006c562bfaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:39.550983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309cb5-5201-42dd-a730-006c562bfaff admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:39.551428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309cb5-5201-42dd-a730-006c562bfaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:39.551946 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309cb5-5201-42dd-a730-006c562bfaff admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:39.552868 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8309cb5-5201-42dd-a730-006c562bfaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:39.554843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8309cb5-5201-42dd-a730-006c562bfaff admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:39.578621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 832/1661] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:39.583149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889dde-920c-4935-bc0d-d5c6af873632 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:39.594308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889dde-920c-4935-bc0d-d5c6af873632 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:39.599373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186d5c1-96c6-41f6-8c09-0f26b5fe7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:39.628672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d5c1-96c6-41f6-8c09-0f26b5fe7ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:39.629287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d5c1-96c6-41f6-8c09-0f26b5fe7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:39.629790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d5c1-96c6-41f6-8c09-0f26b5fe7ab7 admin admin] PATH_INFO: `/v3/projects/1cedd81d20f84badb215d222e1fca3b5/users/5397bcc52afd415fa0632c87743d6215/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:39.671874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186d5c1-96c6-41f6-8c09-0f26b5fe7ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cedd81d20f84badb215d222e1fca3b5, user_id=5397bcc52afd415fa0632c87743d6215, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:39.678515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186d5c1-96c6-41f6-8c09-0f26b5fe7ab7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:39.732841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 830/1662] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:39 2022] PUT /identity/v3/projects/1cedd81d20f84badb215d222e1fca3b5/users/5397bcc52afd415fa0632c87743d6215/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:39.737599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309cb5-5201-42dd-a730-006c562bfaff admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:39.759052 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309cb5-5201-42dd-a730-006c562bfaff admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:39.994309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee269f-143c-4f9a-b7ca-9f8f8d3ec002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:39.995140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee269f-143c-4f9a-b7ca-9f8f8d3ec002 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:39.995963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee269f-143c-4f9a-b7ca-9f8f8d3ec002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:39.998712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee269f-143c-4f9a-b7ca-9f8f8d3ec002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:40.002803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee269f-143c-4f9a-b7ca-9f8f8d3ec002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:40.004967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee269f-143c-4f9a-b7ca-9f8f8d3ec002 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:40.072647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 833/1663] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:40.073883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186d5c1-96c6-41f6-8c09-0f26b5fe7ab7 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:40.090216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186d5c1-96c6-41f6-8c09-0f26b5fe7ab7 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:40.099666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:40.100402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:40.100680 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:40.100953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] PATH_INFO: `/v3/projects/1cedd81d20f84badb215d222e1fca3b5/users/5397bcc52afd415fa0632c87743d6215/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:40.107819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cedd81d20f84badb215d222e1fca3b5, user_id=5397bcc52afd415fa0632c87743d6215, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:40.110384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:40.147880 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 831/1664] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:40 2022] PUT /identity/v3/projects/1cedd81d20f84badb215d222e1fca3b5/users/5397bcc52afd415fa0632c87743d6215/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:40.152921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59b24-3ac3-46b5-bc50-26ff425ca771 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:40.153261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59b24-3ac3-46b5-bc50-26ff425ca771 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:40.153594 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced59b24-3ac3-46b5-bc50-26ff425ca771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:40.216875 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ced59b24-3ac3-46b5-bc50-26ff425ca771 None None] MFA Rules not processed for user `5397bcc52afd415fa0632c87743d6215`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:40.218119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ced59b24-3ac3-46b5-bc50-26ff425ca771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:40.335989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:40.394294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 834/1665] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:40.408040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:40.418295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:40.676180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bffb9c-e9c7-4b2b-9547-381bf5b0065d admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:40.688546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:40.689425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:40.689861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:40.690316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:40.713406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:40.715265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:40.740161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 832/1666] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:40.912359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44a70-2daa-4b94-9d70-1ae7432e1969 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:40.913879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44a70-2daa-4b94-9d70-1ae7432e1969 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:40.914358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44a70-2daa-4b94-9d70-1ae7432e1969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:41.024245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-78c44a70-2daa-4b94-9d70-1ae7432e1969 None None] MFA Rules not processed for user `074e13c753f047968b2560b12d4b53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:41.025779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-78c44a70-2daa-4b94-9d70-1ae7432e1969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:41.265811 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 835/1667] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:41.282854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:41.284376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:41.323435 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce1cc-c59b-402c-b10c-865cd1ad6024 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:41.323733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce1cc-c59b-402c-b10c-865cd1ad6024 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:41.324037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce1cc-c59b-402c-b10c-865cd1ad6024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:41.469995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-5d7ce1cc-c59b-402c-b10c-865cd1ad6024 None None] MFA Rules not processed for user `b069142a9ae44602b9e5cd805ab5e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:41.472897 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5d7ce1cc-c59b-402c-b10c-865cd1ad6024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:41.474456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:41.563662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188868db-e34d-4034-b9d4-014a5a1296f0 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:41.588782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:41.589425 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:41.589711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:41.589988 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:41.614085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:41.617700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:41.652898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 833/1668] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:41.653940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:41.656077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:41.726717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 836/1669] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:41 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:41.793874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6b7e-6f95-4263-bfca-b228185a251e service nova] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:41.820650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:41.823175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:41.825574 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:41.826110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] PATH_INFO: `/v3/users/b5a17c138b524db693ee97277e419a2f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:41.831203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a17c138b524db693ee97277e419a2f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:41.836559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:41.932797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a17c138b524db693ee97277e419a2f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:41.943109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a17c138b524db693ee97277e419a2f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:41.954986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a17c138b524db693ee97277e419a2f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:41.955834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a17c138b524db693ee97277e419a2f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:41.995434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a17c138b524db693ee97277e419a2f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:42.011131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 834/1670] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:41 2022] DELETE /identity/v3/users/b5a17c138b524db693ee97277e419a2f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:42.015818 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a58a-d11c-4d42-90d9-3508c3666180 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:42.016373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a58a-d11c-4d42-90d9-3508c3666180 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:42.016373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a58a-d11c-4d42-90d9-3508c3666180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:42.062031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-1312a58a-d11c-4d42-90d9-3508c3666180 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:42.065183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1312a58a-d11c-4d42-90d9-3508c3666180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:42.150492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:42.209063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 837/1671] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:42.241979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:42.244383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:42.424510 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b52a-cb8f-40bf-ac65-a2ba4d6c7668 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:42.442457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:42.442758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:42.444888 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:42.445342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:42.477628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:42.489082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:42.492078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:42.517354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 835/1672] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:43.819011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312a58a-d11c-4d42-90d9-3508c3666180 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:43.820633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1312a58a-d11c-4d42-90d9-3508c3666180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:43.841327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312a58a-d11c-4d42-90d9-3508c3666180 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:43.857124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:43.857797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:43.858085 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:43.858362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] PATH_INFO: `/v3/users/d8e8bf97668c4b71be1ffcbdb7280712` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:43.859533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e8bf97668c4b71be1ffcbdb7280712)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:43.862113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:43.974153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e8bf97668c4b71be1ffcbdb7280712'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:43.984342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e8bf97668c4b71be1ffcbdb7280712'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:43.990599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:43.992663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:43.996622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e8bf97668c4b71be1ffcbdb7280712'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:43.997402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e8bf97668c4b71be1ffcbdb7280712'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:44.018281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57f5fa-a711-409e-bad8-5bcace0d7987 service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:44.021726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-09754dc7-611a-4072-bff5-d8672eccce71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e8bf97668c4b71be1ffcbdb7280712'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:44.035394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:44.036664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.037139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.037557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] PATH_INFO: `/v3/users/010c871c6afe475ebc260e85b736d407` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.039238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010c871c6afe475ebc260e85b736d407)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:44.043763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:44.059925 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 838/1673] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:43 2022] DELETE /identity/v3/users/d8e8bf97668c4b71be1ffcbdb7280712 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:44.073412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20928fb-4626-4b97-9da3-1af84872ffe7 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.073934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20928fb-4626-4b97-9da3-1af84872ffe7 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.074363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20928fb-4626-4b97-9da3-1af84872ffe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.108515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c20928fb-4626-4b97-9da3-1af84872ffe7 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:44.110276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c20928fb-4626-4b97-9da3-1af84872ffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:44.136260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010c871c6afe475ebc260e85b736d407'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:44.155040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010c871c6afe475ebc260e85b736d407'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:44.182265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010c871c6afe475ebc260e85b736d407'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:44.182997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010c871c6afe475ebc260e85b736d407'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:44.207454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f3023f77-5526-4b9f-9135-b0b872cdc329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010c871c6afe475ebc260e85b736d407'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:44.220970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 836/1674] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:43 2022] DELETE /identity/v3/users/010c871c6afe475ebc260e85b736d407 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:44.227611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d52e4c-ca26-4a47-b57f-77ac2c0714a6 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.228528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d52e4c-ca26-4a47-b57f-77ac2c0714a6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.228796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d52e4c-ca26-4a47-b57f-77ac2c0714a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.248312 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 839/1675] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:44.249971 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8755-ad80-447b-b99b-9df6c18dad48 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.250427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8755-ad80-447b-b99b-9df6c18dad48 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.250857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8755-ad80-447b-b99b-9df6c18dad48 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.252476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 840/1676] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:42:44.278173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2183f-b90c-4b94-a24e-fff6c6f1ea21 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.278676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2183f-b90c-4b94-a24e-fff6c6f1ea21 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.279096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2183f-b90c-4b94-a24e-fff6c6f1ea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.281568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d4d52e4c-ca26-4a47-b57f-77ac2c0714a6 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:44.285337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d4d52e4c-ca26-4a47-b57f-77ac2c0714a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:44.317554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-85c2183f-b90c-4b94-a24e-fff6c6f1ea21 None None] MFA Rules not processed for user `99ee78db03794fbcb572ca1e98f231fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:44.320317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-85c2183f-b90c-4b94-a24e-fff6c6f1ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:44.425364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:44.458207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 841/1677] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:42:44.459880 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2183f-b90c-4b94-a24e-fff6c6f1ea21 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:44.463313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-85c2183f-b90c-4b94-a24e-fff6c6f1ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:44.487730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 837/1678] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:44.545871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d52e4c-ca26-4a47-b57f-77ac2c0714a6 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:44.547530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d4d52e4c-ca26-4a47-b57f-77ac2c0714a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:44.570810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2183f-b90c-4b94-a24e-fff6c6f1ea21 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:44.575082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09324ea-767e-4721-af47-e69f6904a133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:44.575989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09324ea-767e-4721-af47-e69f6904a133 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.576770 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09324ea-767e-4721-af47-e69f6904a133 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.576770 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09324ea-767e-4721-af47-e69f6904a133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.578818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d52e4c-ca26-4a47-b57f-77ac2c0714a6 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:44.589028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09324ea-767e-4721-af47-e69f6904a133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:44.593329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f6b9d-9469-4142-9423-127fbf98e36a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ee78db03794fbcb572ca1e98f231fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:44.594185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09324ea-767e-4721-af47-e69f6904a133 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:44.595072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f6b9d-9469-4142-9423-127fbf98e36a service placement] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.597979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f6b9d-9469-4142-9423-127fbf98e36a service placement] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.598534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f6b9d-9469-4142-9423-127fbf98e36a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.608591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 842/1679] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:44.609469 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09324ea-767e-4721-af47-e69f6904a133 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:44.619559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09324ea-767e-4721-af47-e69f6904a133 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:44.623402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f6b9d-9469-4142-9423-127fbf98e36a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:44.623943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:44.624727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.625974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f6b9d-9469-4142-9423-127fbf98e36a service placement] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:44.631870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.633325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.645639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:44.648544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:44.665505 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 838/1680] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:42:44.694398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 843/1681] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:44.780370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba2c1-832d-46fd-ad64-fc3e61a6a2c3 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:44.780677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba2c1-832d-46fd-ad64-fc3e61a6a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:44.781066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba2c1-832d-46fd-ad64-fc3e61a6a2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:44.844260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-2dcba2c1-832d-46fd-ad64-fc3e61a6a2c3 None None] MFA Rules not processed for user `4b533edbc818460485852b774b6cf477`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:44.845675 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2dcba2c1-832d-46fd-ad64-fc3e61a6a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:44.964184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:44.970489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:44.972644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:45.004164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e348b-53ec-49c0-9a20-fc16c064a597 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:45.030246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:45.031652 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:45.032299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:45.032761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] PATH_INFO: `/v3/projects/f0c2229ba61e4f778bde7ab6da7ab98b` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:45.043313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 839/1682] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:45.046055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c2229ba61e4f778bde7ab6da7ab98b)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:45.052110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:45.052833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcba2c1-832d-46fd-ad64-fc3e61a6a2c3 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:45.056026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2dcba2c1-832d-46fd-ad64-fc3e61a6a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:45.170248 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c2229ba61e4f778bde7ab6da7ab98b', 'request_id': 'req-92d3e29f-c27f-4a00-ad80-d24038d47e67'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:45.187553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c2229ba61e4f778bde7ab6da7ab98b', 'request_id': 'req-92d3e29f-c27f-4a00-ad80-d24038d47e67'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:45.214487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c2229ba61e4f778bde7ab6da7ab98b', 'request_id': 'req-92d3e29f-c27f-4a00-ad80-d24038d47e67'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:45.238602 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] The token cache is being invalidate because project f0c2229ba61e4f778bde7ab6da7ab98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:45.239077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:45.239571 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-92d3e29f-c27f-4a00-ad80-d24038d47e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:45.241438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 844/1683] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:44 2022] DELETE /identity/v3/projects/f0c2229ba61e4f778bde7ab6da7ab98b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:45.246117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ff2c-5ad8-4a8c-a583-ac09cef2e42a None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:45.246403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ff2c-5ad8-4a8c-a583-ac09cef2e42a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:45.246682 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0ff2c-5ad8-4a8c-a583-ac09cef2e42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:45.274450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcba2c1-832d-46fd-ad64-fc3e61a6a2c3 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:45.279883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4ef0ff2c-5ad8-4a8c-a583-ac09cef2e42a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:45.281129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4ef0ff2c-5ad8-4a8c-a583-ac09cef2e42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:45.446560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:45.447820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:45.448117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:45.448395 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:45.453696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:45.460549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 845/1684] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:42:45.465663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed5b0-07f5-4c19-8c08-3d451dbc061c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:45.466280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed5b0-07f5-4c19-8c08-3d451dbc061c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:45.470915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fed5b0-07f5-4c19-8c08-3d451dbc061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:45.551948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b5fed5b0-07f5-4c19-8c08-3d451dbc061c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:45.556509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b5fed5b0-07f5-4c19-8c08-3d451dbc061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:45.586412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 846/1685] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:45.588628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fed5b0-07f5-4c19-8c08-3d451dbc061c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:45.616123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:45.644683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:45.646962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:45.651523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fed5b0-07f5-4c19-8c08-3d451dbc061c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:45.664644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:45.665433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:45.665638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:45.665890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:45.666083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 840/1686] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:45.666521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:45.666948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:45.668689 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:45.697323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 847/1687] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:45.702634 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:45.729102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025d51b-8cd9-4550-90c2-9fe3ad56d588 service nova] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:45.736282 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6476fc-91e1-4154-875c-e5cf358911cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:45.737238 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6476fc-91e1-4154-875c-e5cf358911cd admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:45.737626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6476fc-91e1-4154-875c-e5cf358911cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:45.738291 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6476fc-91e1-4154-875c-e5cf358911cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:45.738908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6476fc-91e1-4154-875c-e5cf358911cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:45.752090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6476fc-91e1-4154-875c-e5cf358911cd admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:45.813979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:45.856916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:45.865380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 841/1688] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:45 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:45.872580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bad0a-e398-4035-a7cd-46e89c2a6f31 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:46.065011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752843b-e297-464b-846f-e42631893627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:46.065649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752843b-e297-464b-846f-e42631893627 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:46.065926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752843b-e297-464b-846f-e42631893627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:46.066197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752843b-e297-464b-846f-e42631893627 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:46.066837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752843b-e297-464b-846f-e42631893627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:46.069114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752843b-e297-464b-846f-e42631893627 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:46.126591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 848/1689] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:45 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:46.131032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6476fc-91e1-4154-875c-e5cf358911cd admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:46.144658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6476fc-91e1-4154-875c-e5cf358911cd admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:46.175970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff5504-6ec4-4df2-89e6-977f367f3ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:46.176613 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5504-6ec4-4df2-89e6-977f367f3ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:46.176894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5504-6ec4-4df2-89e6-977f367f3ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:46.177167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff5504-6ec4-4df2-89e6-977f367f3ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:46.177827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff5504-6ec4-4df2-89e6-977f367f3ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:46.186480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff5504-6ec4-4df2-89e6-977f367f3ad2 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:46.221903 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 842/1690] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:46.226391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752843b-e297-464b-846f-e42631893627 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:46.240321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752843b-e297-464b-846f-e42631893627 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:46.253620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023af396-1410-400b-a9f6-83f035a8c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:46.254457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023af396-1410-400b-a9f6-83f035a8c974 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:46.254888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023af396-1410-400b-a9f6-83f035a8c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:46.255309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023af396-1410-400b-a9f6-83f035a8c974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:46.256155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023af396-1410-400b-a9f6-83f035a8c974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:46.258519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023af396-1410-400b-a9f6-83f035a8c974 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:46.271288 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 849/1691] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:46.275472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff5504-6ec4-4df2-89e6-977f367f3ad2 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:46.294025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff5504-6ec4-4df2-89e6-977f367f3ad2 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:46.303956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bfce8-8873-4bdd-9dd1-e3863489235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:46.305497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bfce8-8873-4bdd-9dd1-e3863489235b admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:46.315996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bfce8-8873-4bdd-9dd1-e3863489235b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:46.317138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bfce8-8873-4bdd-9dd1-e3863489235b admin admin] PATH_INFO: `/v3/projects/a32a7a83094d43848be4c750655f96f5/users/f77af1ed3cbf44fcb137e4bc3185cd71/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:46.357860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bfce8-8873-4bdd-9dd1-e3863489235b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32a7a83094d43848be4c750655f96f5, user_id=f77af1ed3cbf44fcb137e4bc3185cd71, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:46.361332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bfce8-8873-4bdd-9dd1-e3863489235b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:46.415243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc8ca-cfe4-44af-86f8-37976c964dec None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:46.416734 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc8ca-cfe4-44af-86f8-37976c964dec None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:46.416986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 843/1692] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:46 2022] PUT /identity/v3/projects/a32a7a83094d43848be4c750655f96f5/users/f77af1ed3cbf44fcb137e4bc3185cd71/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:46.417444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffc8ca-cfe4-44af-86f8-37976c964dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:46.487158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-38ffc8ca-cfe4-44af-86f8-37976c964dec None None] MFA Rules not processed for user `f77af1ed3cbf44fcb137e4bc3185cd71`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:46.487997 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-38ffc8ca-cfe4-44af-86f8-37976c964dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:46.588623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 850/1693] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:46.589958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bfce8-8873-4bdd-9dd1-e3863489235b admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:46.746109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bfce8-8873-4bdd-9dd1-e3863489235b admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:46.754255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:46.756465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:46.757056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:46.757804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:46.758853 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:46.763275 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:46.876256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 844/1694] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:46 2022] POST /identity/v3/projects => generated 387 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:46.879450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffc8ca-cfe4-44af-86f8-37976c964dec None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:46.898728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffc8ca-cfe4-44af-86f8-37976c964dec None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:47.013752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:47.029539 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9a62-ac32-4b41-b4b6-d156c6945f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:47.031372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9a62-ac32-4b41-b4b6-d156c6945f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.031906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9a62-ac32-4b41-b4b6-d156c6945f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.032337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9a62-ac32-4b41-b4b6-d156c6945f1e admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.033235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd9a62-ac32-4b41-b4b6-d156c6945f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:47.040023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd9a62-ac32-4b41-b4b6-d156c6945f1e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:47.072782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:47.074566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:47.102546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73867-30a1-47cb-a4e1-2d5e61ee4ec8 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:47.120384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:47.120984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.121390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.121581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] PATH_INFO: `/v3/projects/0943ca43e6764b3caf09e3cd2a020052` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.126174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0943ca43e6764b3caf09e3cd2a020052)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:47.128541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:47.134515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 851/1695] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:46 2022] POST /identity/v3/users => generated 300 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:47.134515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141b531-3981-46c0-a6d9-4bcf7e91be06 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.134515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141b531-3981-46c0-a6d9-4bcf7e91be06 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.135168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141b531-3981-46c0-a6d9-4bcf7e91be06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.199620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4141b531-3981-46c0-a6d9-4bcf7e91be06 None None] MFA Rules not processed for user `c0a97aa2248e465fa43e66fd74fb96d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:47.203128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4141b531-3981-46c0-a6d9-4bcf7e91be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:47.242271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0943ca43e6764b3caf09e3cd2a020052', 'request_id': 'req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.254717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0943ca43e6764b3caf09e3cd2a020052', 'request_id': 'req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.265358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0943ca43e6764b3caf09e3cd2a020052', 'request_id': 'req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.283091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] The token cache is being invalidate because project 0943ca43e6764b3caf09e3cd2a020052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:47.283909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.285717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.291631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 845/1696] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:47 2022] DELETE /identity/v3/projects/0943ca43e6764b3caf09e3cd2a020052 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:47.293037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:47.295188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:47.374914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:47.389634 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 852/1697] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:47.390907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141b531-3981-46c0-a6d9-4bcf7e91be06 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:47.396729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4141b531-3981-46c0-a6d9-4bcf7e91be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:47.422143 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141b531-3981-46c0-a6d9-4bcf7e91be06 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:47.434926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:47.435596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.436347 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.436347 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] PATH_INFO: `/v3/users/5397bcc52afd415fa0632c87743d6215` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.437342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5397bcc52afd415fa0632c87743d6215)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:47.439471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:47.440947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc1f0-7fd2-4334-812d-3e038b3b6bb5 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:47.449992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc662-e962-4686-a416-dbb319513f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:47.451064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc662-e962-4686-a416-dbb319513f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.452052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc662-e962-4686-a416-dbb319513f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.452694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc662-e962-4686-a416-dbb319513f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.453740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc662-e962-4686-a416-dbb319513f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:47.455871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc662-e962-4686-a416-dbb319513f3f admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:47.470619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 846/1698] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:47.472546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3511b8-d467-402f-b0a8-545e900b197c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.473052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3511b8-d467-402f-b0a8-545e900b197c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.473475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3511b8-d467-402f-b0a8-545e900b197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.504513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-ba3511b8-d467-402f-b0a8-545e900b197c None None] MFA Rules not processed for user `c0a97aa2248e465fa43e66fd74fb96d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:47.506753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ba3511b8-d467-402f-b0a8-545e900b197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:47.539020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5397bcc52afd415fa0632c87743d6215'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.539816 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5397bcc52afd415fa0632c87743d6215'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.554177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5397bcc52afd415fa0632c87743d6215'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.555020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5397bcc52afd415fa0632c87743d6215'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.566104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5397bcc52afd415fa0632c87743d6215'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:47.596845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 853/1699] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:47 2022] DELETE /identity/v3/users/5397bcc52afd415fa0632c87743d6215 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:47.597870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:47.599514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:47.626034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 847/1700] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:47.638556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3511b8-d467-402f-b0a8-545e900b197c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:47.640208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ba3511b8-d467-402f-b0a8-545e900b197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:47.678767 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:47.716528 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d937a-2f38-405a-886d-51b38ecc55d5 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:47.735398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144cef2-1880-407f-89a8-ab3ba507b20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:47.743137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144cef2-1880-407f-89a8-ab3ba507b20d admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.748402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144cef2-1880-407f-89a8-ab3ba507b20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.749198 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144cef2-1880-407f-89a8-ab3ba507b20d admin admin] PATH_INFO: `/v3/projects/276f6dbada414c1f84a8a9ce5736037c/users/f6894c5e965d4b2d86a045e7077a1331/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.787529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3511b8-d467-402f-b0a8-545e900b197c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:47.794823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144cef2-1880-407f-89a8-ab3ba507b20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=276f6dbada414c1f84a8a9ce5736037c, user_id=f6894c5e965d4b2d86a045e7077a1331, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:47.803809 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144cef2-1880-407f-89a8-ab3ba507b20d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:47.838428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 854/1701] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:47 2022] PUT /identity/v3/projects/276f6dbada414c1f84a8a9ce5736037c/users/f6894c5e965d4b2d86a045e7077a1331/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:47.839587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144cef2-1880-407f-89a8-ab3ba507b20d admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:47.910216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a2cd9-1eb8-4c2c-917d-99563ed01fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:47.910971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2cd9-1eb8-4c2c-917d-99563ed01fc0 service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.911517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2cd9-1eb8-4c2c-917d-99563ed01fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.912424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2cd9-1eb8-4c2c-917d-99563ed01fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.914386 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-770a2cd9-1eb8-4c2c-917d-99563ed01fc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:47.921220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:47.969237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144cef2-1880-407f-89a8-ab3ba507b20d admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:47.990824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09854427-a5c3-4eeb-a127-6432dd682f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:47.991580 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854427-a5c3-4eeb-a127-6432dd682f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:47.994084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854427-a5c3-4eeb-a127-6432dd682f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:47.994570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854427-a5c3-4eeb-a127-6432dd682f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:47.996300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09854427-a5c3-4eeb-a127-6432dd682f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:48.000088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09854427-a5c3-4eeb-a127-6432dd682f62 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:48.021780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 855/1702] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:42:48.023037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09854427-a5c3-4eeb-a127-6432dd682f62 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:48.047341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a2cd9-1eb8-4c2c-917d-99563ed01fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:48.049430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a2cd9-1eb8-4c2c-917d-99563ed01fc0 service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:48.050083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09854427-a5c3-4eeb-a127-6432dd682f62 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:48.067214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:48.069501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:48.069501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:48.069501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] PATH_INFO: `/v3/projects/276f6dbada414c1f84a8a9ce5736037c/users/f6894c5e965d4b2d86a045e7077a1331/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:48.074961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276f6dbada414c1f84a8a9ce5736037c, user_id=f6894c5e965d4b2d86a045e7077a1331, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:48.078211 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:48.093028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 848/1703] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:42:48.097072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 856/1704] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:48 2022] PUT /identity/v3/projects/276f6dbada414c1f84a8a9ce5736037c/users/f6894c5e965d4b2d86a045e7077a1331/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:48.120376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2d8d1-ac41-4be5-a9b7-0942a48b6955 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:48.120376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2d8d1-ac41-4be5-a9b7-0942a48b6955 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:48.120376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2d8d1-ac41-4be5-a9b7-0942a48b6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:48.209662 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-b0f2d8d1-ac41-4be5-a9b7-0942a48b6955 None None] MFA Rules not processed for user `f6894c5e965d4b2d86a045e7077a1331`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:48.211280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b0f2d8d1-ac41-4be5-a9b7-0942a48b6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:48.412794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 849/1705] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:48.426738 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:48.428673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:48.572195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb0aaf-8299-4053-b004-95efd503c499 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:48.576194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:48.576845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:48.577129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:48.577407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:48.596062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:48.597325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:48.615845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 857/1706] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:48.735614 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2d8d1-ac41-4be5-a9b7-0942a48b6955 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:48.882876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2d8d1-ac41-4be5-a9b7-0942a48b6955 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:48.896866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:48.897697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:48.897976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:48.898255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] PATH_INFO: `/v3/users/f77af1ed3cbf44fcb137e4bc3185cd71` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:48.902772 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77af1ed3cbf44fcb137e4bc3185cd71)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:48.904800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:48.986697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:49.000759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:49.002932 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:49.020408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77af1ed3cbf44fcb137e4bc3185cd71'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.030401 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b571-935e-4c8c-b4ab-5b9fecfa1117 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:49.043230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77af1ed3cbf44fcb137e4bc3185cd71'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.074370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:49.077489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.078189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.078750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] PATH_INFO: `/v3/projects/66c940c520804b568eebd82cfd5a95fd` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.081395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c940c520804b568eebd82cfd5a95fd)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:49.085138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77af1ed3cbf44fcb137e4bc3185cd71'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.086070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77af1ed3cbf44fcb137e4bc3185cd71'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.092618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:49.133549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77af1ed3cbf44fcb137e4bc3185cd71'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.150824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 850/1707] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:48 2022] DELETE /identity/v3/users/f77af1ed3cbf44fcb137e4bc3185cd71 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:49.151964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:49.155445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:49.235414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c940c520804b568eebd82cfd5a95fd', 'request_id': 'req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.241340 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:49.255726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c940c520804b568eebd82cfd5a95fd', 'request_id': 'req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.273627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c940c520804b568eebd82cfd5a95fd', 'request_id': 'req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.303078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] The token cache is being invalidate because project 66c940c520804b568eebd82cfd5a95fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:49.303272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.304485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2d21dbd5-5b6b-4328-a375-50c6ebb5a999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.311302 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 858/1708] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:48 2022] DELETE /identity/v3/projects/66c940c520804b568eebd82cfd5a95fd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:42:49.312919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ca63-d9b1-4a02-940d-5fb5db5bd50e None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.313216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ca63-d9b1-4a02-940d-5fb5db5bd50e None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.313499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ca63-d9b1-4a02-940d-5fb5db5bd50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.339290 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac2471-2625-439f-b482-dd0cccd3312c admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:49.345135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3c65ca63-d9b1-4a02-940d-5fb5db5bd50e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:49.346383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3c65ca63-d9b1-4a02-940d-5fb5db5bd50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:49.472507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 859/1709] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:49.472507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542e33-f13b-4193-9f07-531a117fae88 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.472507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542e33-f13b-4193-9f07-531a117fae88 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.473280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542e33-f13b-4193-9f07-531a117fae88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.493239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:49.493962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.494240 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.494517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] PATH_INFO: `/v3/users/1e547c7d218b4a72bef620d1b47769b8` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.501091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e547c7d218b4a72bef620d1b47769b8)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:49.503210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:49.506086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-d1542e33-f13b-4193-9f07-531a117fae88 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:49.508729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d1542e33-f13b-4193-9f07-531a117fae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:49.523827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 860/1710] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:49.531416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996a6f-7d32-42a0-8e34-1c9dea74f184 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.531858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996a6f-7d32-42a0-8e34-1c9dea74f184 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.532222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996a6f-7d32-42a0-8e34-1c9dea74f184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.569456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b3996a6f-7d32-42a0-8e34-1c9dea74f184 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:49.574823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b3996a6f-7d32-42a0-8e34-1c9dea74f184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:49.593482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 861/1711] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:49.595089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996a6f-7d32-42a0-8e34-1c9dea74f184 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:49.598567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e547c7d218b4a72bef620d1b47769b8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.599129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b3996a6f-7d32-42a0-8e34-1c9dea74f184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:49.620544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e547c7d218b4a72bef620d1b47769b8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.625283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:49.638479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e547c7d218b4a72bef620d1b47769b8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.639227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e547c7d218b4a72bef620d1b47769b8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.667994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e547c7d218b4a72bef620d1b47769b8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:49.682368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 851/1712] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:49 2022] DELETE /identity/v3/users/1e547c7d218b4a72bef620d1b47769b8 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:49.682368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:49.684555 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:49.776915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996a6f-7d32-42a0-8e34-1c9dea74f184 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:49.838433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793f131-bb25-4406-9c9f-5674c07b6cba admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:49.847916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96949ad0-c556-45a7-b66d-103547b4bbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:49.848719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96949ad0-c556-45a7-b66d-103547b4bbea admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.849100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96949ad0-c556-45a7-b66d-103547b4bbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.849474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96949ad0-c556-45a7-b66d-103547b4bbea admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.850258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96949ad0-c556-45a7-b66d-103547b4bbea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:49.850667 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96949ad0-c556-45a7-b66d-103547b4bbea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:49.858201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96949ad0-c556-45a7-b66d-103547b4bbea admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:49.876914 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10e5a8-9a81-4f10-aefb-e3a78780670f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:49.877547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10e5a8-9a81-4f10-aefb-e3a78780670f service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.877835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10e5a8-9a81-4f10-aefb-e3a78780670f service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.878111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10e5a8-9a81-4f10-aefb-e3a78780670f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.892563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 852/1713] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:49.892785 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7e10e5a8-9a81-4f10-aefb-e3a78780670f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:49.893962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad774e27-fc68-4de0-9745-f235a0e0e279 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.894352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad774e27-fc68-4de0-9745-f235a0e0e279 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.894734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad774e27-fc68-4de0-9745-f235a0e0e279 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.896390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 853/1714] 10.222.0.55 () {54 vars in 912 bytes} [Thu Sep 1 15:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:42:49.903916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad774e27-fc68-4de0-9745-f235a0e0e279 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:49.920784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10e5a8-9a81-4f10-aefb-e3a78780670f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:49.926605 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10e5a8-9a81-4f10-aefb-e3a78780670f service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:49.939584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad774e27-fc68-4de0-9745-f235a0e0e279 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:49.953592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 862/1715] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:49.955039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:49.955840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.956187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.956561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:49.957325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:49.959271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8082-a7a4-497f-a3a0-2984effc0963 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:49.959562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8082-a7a4-497f-a3a0-2984effc0963 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:49.959678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:49.960608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8082-a7a4-497f-a3a0-2984effc0963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.020424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 854/1716] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:49 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:50.024483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:50.031145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.076909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f96b8082-a7a4-497f-a3a0-2984effc0963 None None] MFA Rules not processed for user `0319076e113748d4a86e5906559abdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:50.081799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f96b8082-a7a4-497f-a3a0-2984effc0963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.106573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:50.174157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6200b68-4886-4dff-9b83-ae5d02e93463 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:50.195919 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:50.199750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.200149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.200556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] PATH_INFO: `/v3/projects/1cedd81d20f84badb215d222e1fca3b5` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.202119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cedd81d20f84badb215d222e1fca3b5)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:50.204784 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:50.211446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 863/1717] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:50.214231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b8082-a7a4-497f-a3a0-2984effc0963 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:50.263912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b8082-a7a4-497f-a3a0-2984effc0963 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:50.271151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:50.272223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.272582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.274013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.275745 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:50.287207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:50.311101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cedd81d20f84badb215d222e1fca3b5', 'request_id': 'req-df0bd383-c037-4705-8de6-ccc9369bd3f2'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.314025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:50.331927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cedd81d20f84badb215d222e1fca3b5', 'request_id': 'req-df0bd383-c037-4705-8de6-ccc9369bd3f2'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.344011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 864/1718] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:50 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:50.344011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:50.356057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.361920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cedd81d20f84badb215d222e1fca3b5', 'request_id': 'req-df0bd383-c037-4705-8de6-ccc9369bd3f2'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.381137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134d869-cd63-42d7-9100-68bd6ddc03d1 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:50.383481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] The token cache is being invalidate because project 1cedd81d20f84badb215d222e1fca3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:50.384086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.385954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.393913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 855/1719] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:50 2022] DELETE /identity/v3/projects/1cedd81d20f84badb215d222e1fca3b5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:50.397189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:50.399654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.483422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:50.485316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.486329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.487087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] PATH_INFO: `/v3/projects/a89bca1b38fa434c8b9d8a9715c92f9b` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.491019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a89bca1b38fa434c8b9d8a9715c92f9b)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:50.510554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:50.522507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd383-c037-4705-8de6-ccc9369bd3f2 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:50.526908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:50.527600 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.528065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.528774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.531069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.544164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:50.545724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:50.558782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 856/1720] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:50.559800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:50.561909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.578351 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16fb23-07c0-4e38-b758-2761385d08ed service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:50.584311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f21c34-d7be-482f-81a2-4b4d6eaed69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:50.584937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21c34-d7be-482f-81a2-4b4d6eaed69a admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.585277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21c34-d7be-482f-81a2-4b4d6eaed69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.585561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21c34-d7be-482f-81a2-4b4d6eaed69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.586370 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f21c34-d7be-482f-81a2-4b4d6eaed69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:50.588516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f21c34-d7be-482f-81a2-4b4d6eaed69a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:50.601128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 857/1721] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:50.602797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee1f-c72a-4bd0-b83a-e31100a3a7d0 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.603877 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee1f-c72a-4bd0-b83a-e31100a3a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.604346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee1f-c72a-4bd0-b83a-e31100a3a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.635570 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-b06bee1f-c72a-4bd0-b83a-e31100a3a7d0 None None] MFA Rules not processed for user `4b533edbc818460485852b774b6cf477`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:50.636923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b06bee1f-c72a-4bd0-b83a-e31100a3a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.653451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a89bca1b38fa434c8b9d8a9715c92f9b', 'request_id': 'req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.666280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a89bca1b38fa434c8b9d8a9715c92f9b', 'request_id': 'req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.679955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a89bca1b38fa434c8b9d8a9715c92f9b', 'request_id': 'req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.708076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] The token cache is being invalidate because project a89bca1b38fa434c8b9d8a9715c92f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:50.708379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.709213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4d9d14c3-0c87-4bf4-87b0-aca629e16f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:50.712770 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 865/1722] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:50 2022] DELETE /identity/v3/projects/a89bca1b38fa434c8b9d8a9715c92f9b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:50.714113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460941-9285-42c8-9da2-83a6f5fc3323 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.714403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460941-9285-42c8-9da2-83a6f5fc3323 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.714677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460941-9285-42c8-9da2-83a6f5fc3323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.718579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 858/1723] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:50.719766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bee1f-c72a-4bd0-b83a-e31100a3a7d0 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:50.791128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ef460941-9285-42c8-9da2-83a6f5fc3323 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:50.792907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ef460941-9285-42c8-9da2-83a6f5fc3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.834895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bee1f-c72a-4bd0-b83a-e31100a3a7d0 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:50.838574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:50.848598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:50.849763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.850198 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.850307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.851102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:50.853349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:50.873928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 859/1724] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:50.874810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:50.876676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.887651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 866/1725] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:50.889057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef460941-9285-42c8-9da2-83a6f5fc3323 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:50.890815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ef460941-9285-42c8-9da2-83a6f5fc3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:50.909903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef460941-9285-42c8-9da2-83a6f5fc3323 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:50.913914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39d641-9edc-46ee-a756-1085c47296d4 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:50.916837 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabdd3f-f69e-4610-bef3-ae9acae177ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:50.917707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdd3f-f69e-4610-bef3-ae9acae177ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.918094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdd3f-f69e-4610-bef3-ae9acae177ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.918379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabdd3f-f69e-4610-bef3-ae9acae177ca admin admin] PATH_INFO: `/v3/projects/0a5f664054064fce9d1790d723c0c550/users/66d7fa9a35294822b02de1dec8f162bf/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.919200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:50.919863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.920207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.920486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] PATH_INFO: `/v3/users/b069142a9ae44602b9e5cd805ab5e0c4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:50.921621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b069142a9ae44602b9e5cd805ab5e0c4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:50.923542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:50.929039 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:50.941614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabdd3f-f69e-4610-bef3-ae9acae177ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5f664054064fce9d1790d723c0c550, user_id=66d7fa9a35294822b02de1dec8f162bf, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:50.947086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabdd3f-f69e-4610-bef3-ae9acae177ca admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:50.984698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 867/1726] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:50 2022] PUT /identity/v3/projects/0a5f664054064fce9d1790d723c0c550/users/66d7fa9a35294822b02de1dec8f162bf/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:50.986575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79afe5-073a-4c3d-bd09-132f1c757cae None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:50.987644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79afe5-073a-4c3d-bd09-132f1c757cae None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:50.988068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79afe5-073a-4c3d-bd09-132f1c757cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:51.009842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ca79afe5-073a-4c3d-bd09-132f1c757cae None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:51.011541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ca79afe5-073a-4c3d-bd09-132f1c757cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:51.039683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b069142a9ae44602b9e5cd805ab5e0c4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:51.048100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b069142a9ae44602b9e5cd805ab5e0c4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:51.061288 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b069142a9ae44602b9e5cd805ab5e0c4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:51.062475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b069142a9ae44602b9e5cd805ab5e0c4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:51.095091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-94842752-be1e-4c8f-b0ee-c04b53a9aa09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b069142a9ae44602b9e5cd805ab5e0c4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:51.116764 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 860/1727] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:50 2022] DELETE /identity/v3/users/b069142a9ae44602b9e5cd805ab5e0c4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:51.121174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 868/1728] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:51.122415 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dcc3f-fe6c-4c16-9cfb-57cc93288f10 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:51.123387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dcc3f-fe6c-4c16-9cfb-57cc93288f10 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:51.123766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dcc3f-fe6c-4c16-9cfb-57cc93288f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:51.124204 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b880c3-b31d-43fb-974b-08310b3a1497 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:51.127267 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b880c3-b31d-43fb-974b-08310b3a1497 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:51.127692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b880c3-b31d-43fb-974b-08310b3a1497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:51.170260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-98b880c3-b31d-43fb-974b-08310b3a1497 None None] MFA Rules not processed for user `074e13c753f047968b2560b12d4b53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:51.171663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-98b880c3-b31d-43fb-974b-08310b3a1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:51.193491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-f46dcc3f-fe6c-4c16-9cfb-57cc93288f10 None None] MFA Rules not processed for user `66d7fa9a35294822b02de1dec8f162bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:51.199887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f46dcc3f-fe6c-4c16-9cfb-57cc93288f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:51.315017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 869/1729] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:51.316614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b880c3-b31d-43fb-974b-08310b3a1497 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:51.363176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 861/1730] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:51.367954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dcc3f-fe6c-4c16-9cfb-57cc93288f10 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:51.370610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f46dcc3f-fe6c-4c16-9cfb-57cc93288f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:51.513999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:51.523440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b880c3-b31d-43fb-974b-08310b3a1497 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:51.533345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dcc3f-fe6c-4c16-9cfb-57cc93288f10 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:51.538418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:51.539289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:51.539668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:51.540702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:51.541697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:51.543720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:51.548645 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:51.553434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:51.553949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:51.554369 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:51.557107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:51.559374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:51.564161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:51.578730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:51.590483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 862/1731] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:51 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:42:51.591922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:51.594331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:51.619933 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 870/1732] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:51.620901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:51.656194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e02f9-c665-4d85-8984-d76f7bdfa661 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:51.691335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e513db6-b9cf-4115-b490-ee08b80fd01e admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:51.708559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ee78db03794fbcb572ca1e98f231fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:51.709639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:51.709992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:51.710296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:51.712407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:51.738889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:51.740572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:51.760435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 863/1733] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:51.761060 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:51.823492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:51.824747 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:51.825583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:51.826527 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:51.828797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:51.833676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:51.861324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a3abd-32c0-4437-b0d7-406efa44873e service placement] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:51.867089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac5fe4-d0e4-4bac-bf53-00f16ca758cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:51.867867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac5fe4-d0e4-4bac-bf53-00f16ca758cf admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:51.868083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac5fe4-d0e4-4bac-bf53-00f16ca758cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:51.868389 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac5fe4-d0e4-4bac-bf53-00f16ca758cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:51.870264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac5fe4-d0e4-4bac-bf53-00f16ca758cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:51.871161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac5fe4-d0e4-4bac-bf53-00f16ca758cf admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:51.901519 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 871/1734] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:51 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:51.906764 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:51.913054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:51.922349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 864/1735] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:51 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:51.922349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac5fe4-d0e4-4bac-bf53-00f16ca758cf admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:51.946411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673ce0c-a0ec-4a81-b62e-b857489b8e81 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.030428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac5fe4-d0e4-4bac-bf53-00f16ca758cf admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.036270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27f14-6b3b-43df-98c9-f1c62d4bf0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.036909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27f14-6b3b-43df-98c9-f1c62d4bf0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.037196 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27f14-6b3b-43df-98c9-f1c62d4bf0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.037525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27f14-6b3b-43df-98c9-f1c62d4bf0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.038195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27f14-6b3b-43df-98c9-f1c62d4bf0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.040050 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27f14-6b3b-43df-98c9-f1c62d4bf0e5 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:52.058178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 865/1736] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:52.059167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27f14-6b3b-43df-98c9-f1c62d4bf0e5 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:52.070993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27f14-6b3b-43df-98c9-f1c62d4bf0e5 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.076838 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a94e4-de22-4c7a-abea-1e2d27eefe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.077483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a94e4-de22-4c7a-abea-1e2d27eefe98 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.077770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a94e4-de22-4c7a-abea-1e2d27eefe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.078109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a94e4-de22-4c7a-abea-1e2d27eefe98 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.078790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a94e4-de22-4c7a-abea-1e2d27eefe98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.080986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a94e4-de22-4c7a-abea-1e2d27eefe98 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:52.093779 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:52.106504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.107396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.115300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.115970 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] PATH_INFO: `/v3/projects/09e39448e2cb4447a2db73234b3ffae1` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.117869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e39448e2cb4447a2db73234b3ffae1)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.120432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:52.133012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 866/1737] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:52 2022] POST /identity/v3/users => generated 288 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:52.134705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a94e4-de22-4c7a-abea-1e2d27eefe98 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:52.147283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a94e4-de22-4c7a-abea-1e2d27eefe98 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.160360 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c5e2-81fd-48da-af59-ecff4d3c18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.161124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c5e2-81fd-48da-af59-ecff4d3c18ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.161411 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c5e2-81fd-48da-af59-ecff4d3c18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.162832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c5e2-81fd-48da-af59-ecff4d3c18ce admin admin] PATH_INFO: `/v3/projects/59e22ae1ad3247b7a08d92f3d451c910/users/a04efabd74cc492593d526b6d5a0cc41/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.203928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066c5e2-81fd-48da-af59-ecff4d3c18ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e22ae1ad3247b7a08d92f3d451c910, user_id=a04efabd74cc492593d526b6d5a0cc41, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.207008 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066c5e2-81fd-48da-af59-ecff4d3c18ce admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:52.210059 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e39448e2cb4447a2db73234b3ffae1', 'request_id': 'req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.219606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e39448e2cb4447a2db73234b3ffae1', 'request_id': 'req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.232246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e39448e2cb4447a2db73234b3ffae1', 'request_id': 'req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.236294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 867/1738] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:52 2022] PUT /identity/v3/projects/59e22ae1ad3247b7a08d92f3d451c910/users/a04efabd74cc492593d526b6d5a0cc41/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:52.240647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c5e2-81fd-48da-af59-ecff4d3c18ce admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:52.263175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] The token cache is being invalidate because project 09e39448e2cb4447a2db73234b3ffae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:52.263550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.265048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.266793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 872/1739] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:51 2022] DELETE /identity/v3/projects/09e39448e2cb4447a2db73234b3ffae1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:52.267657 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:52.271607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:52.299896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:52.364180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c5e2-81fd-48da-af59-ecff4d3c18ce admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.371186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.372466 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.372972 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.373446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.375042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.376911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:52.394568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 868/1740] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:52.395996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:52.398380 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:52.416542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fe4a5-9ebb-4098-9204-da41397d3f58 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.423531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.424604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.425106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.425777 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] PATH_INFO: `/v3/projects/a32a7a83094d43848be4c750655f96f5` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.428336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32a7a83094d43848be4c750655f96f5)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.432985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:52.461306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7b57-3fa2-4b28-8a40-28bcc54d1d0d admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.484243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1d67-c28b-4c80-aa30-30bee0c98286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.484840 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1d67-c28b-4c80-aa30-30bee0c98286 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.485133 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1d67-c28b-4c80-aa30-30bee0c98286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.485380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1d67-c28b-4c80-aa30-30bee0c98286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.486148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1d67-c28b-4c80-aa30-30bee0c98286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.487722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1d67-c28b-4c80-aa30-30bee0c98286 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:52.510153 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32a7a83094d43848be4c750655f96f5', 'request_id': 'req-0729b19e-e629-4959-a000-f3dcc17af74d'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.519117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32a7a83094d43848be4c750655f96f5', 'request_id': 'req-0729b19e-e629-4959-a000-f3dcc17af74d'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.526070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 873/1741] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:52.527346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0daf8-248f-4754-8d95-e904342b2aaa None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.527654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0daf8-248f-4754-8d95-e904342b2aaa None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.527972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0daf8-248f-4754-8d95-e904342b2aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.545944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32a7a83094d43848be4c750655f96f5', 'request_id': 'req-0729b19e-e629-4959-a000-f3dcc17af74d'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.571014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] The token cache is being invalidate because project a32a7a83094d43848be4c750655f96f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:52.571209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.573480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:52.576197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 869/1742] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:52 2022] DELETE /identity/v3/projects/a32a7a83094d43848be4c750655f96f5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:52.577138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:52.581406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:52.604241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b7f0daf8-248f-4754-8d95-e904342b2aaa None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:52.606109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b7f0daf8-248f-4754-8d95-e904342b2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:52.710225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 874/1743] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:52.711599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0daf8-248f-4754-8d95-e904342b2aaa None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:52.714099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b7f0daf8-248f-4754-8d95-e904342b2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:52.731448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0daf8-248f-4754-8d95-e904342b2aaa None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.745739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.746721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.747112 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.747487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] PATH_INFO: `/v3/projects/59e22ae1ad3247b7a08d92f3d451c910/users/a04efabd74cc492593d526b6d5a0cc41/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.752799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e22ae1ad3247b7a08d92f3d451c910, user_id=a04efabd74cc492593d526b6d5a0cc41, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.761606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:52.763057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:52.795996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 875/1744] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:52 2022] PUT /identity/v3/projects/59e22ae1ad3247b7a08d92f3d451c910/users/a04efabd74cc492593d526b6d5a0cc41/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:52.796964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:52.800812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:52.823808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729b19e-e629-4959-a000-f3dcc17af74d admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.963405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afaae8-b708-4dfb-a308-fdc56dfdb9be admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:52.969726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:52.970388 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:52.970672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:52.970947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] PATH_INFO: `/v3/users/f6894c5e965d4b2d86a045e7077a1331` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:52.972133 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6894c5e965d4b2d86a045e7077a1331)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:52.974162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:53.041474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:53.051285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bc987-0964-4f56-a8d1-a648304f40aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:53.055216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc987-0964-4f56-a8d1-a648304f40aa admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.055514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc987-0964-4f56-a8d1-a648304f40aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.056137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc987-0964-4f56-a8d1-a648304f40aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.057081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bc987-0964-4f56-a8d1-a648304f40aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:53.058785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bc987-0964-4f56-a8d1-a648304f40aa admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:53.065011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6894c5e965d4b2d86a045e7077a1331'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:53.067042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6894c5e965d4b2d86a045e7077a1331'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:53.085006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6894c5e965d4b2d86a045e7077a1331'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:53.087058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6894c5e965d4b2d86a045e7077a1331'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:53.101763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 870/1745] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:53.101763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f01fd-8bea-487c-b380-ed51ab19e538 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.101763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f01fd-8bea-487c-b380-ed51ab19e538 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.101763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f01fd-8bea-487c-b380-ed51ab19e538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.107157 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8630cc4d-6bc0-418f-b3b8-3032f4d84863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6894c5e965d4b2d86a045e7077a1331'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:53.160614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 876/1746] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:42:52 2022] DELETE /identity/v3/users/f6894c5e965d4b2d86a045e7077a1331 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:53.177089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943b6c-6514-4f2f-b8c1-a36a4ad615ef None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.178304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943b6c-6514-4f2f-b8c1-a36a4ad615ef None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.178884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943b6c-6514-4f2f-b8c1-a36a4ad615ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.187666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-523f01fd-8bea-487c-b380-ed51ab19e538 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:53.189526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-523f01fd-8bea-487c-b380-ed51ab19e538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:53.270216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-5c943b6c-6514-4f2f-b8c1-a36a4ad615ef None None] MFA Rules not processed for user `a04efabd74cc492593d526b6d5a0cc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:53.278766 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5c943b6c-6514-4f2f-b8c1-a36a4ad615ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:53.349908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 871/1747] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:53.353145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41ffd-e516-452b-8a7c-d3473f4b4004 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.353420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41ffd-e516-452b-8a7c-d3473f4b4004 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.353700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41ffd-e516-452b-8a7c-d3473f4b4004 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.359298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 872/1748] 10.222.0.55 () {54 vars in 912 bytes} [Thu Sep 1 15:42:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:42:53.360637 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a993d7-ab65-49b0-a375-6d773e1a7efb None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.360927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a993d7-ab65-49b0-a375-6d773e1a7efb None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.362489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a993d7-ab65-49b0-a375-6d773e1a7efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.438628 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-26a993d7-ab65-49b0-a375-6d773e1a7efb None None] MFA Rules not processed for user `3c921ff0cbca40c7944ae3fb77cc96b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:53.441998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-26a993d7-ab65-49b0-a375-6d773e1a7efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:53.456723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 877/1749] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:53.457774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943b6c-6514-4f2f-b8c1-a36a4ad615ef None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:53.459624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5c943b6c-6514-4f2f-b8c1-a36a4ad615ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:53.514365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943b6c-6514-4f2f-b8c1-a36a4ad615ef None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:53.525333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122c51d-5f3e-4167-976c-9818452edea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:53.526220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122c51d-5f3e-4167-976c-9818452edea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.527265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122c51d-5f3e-4167-976c-9818452edea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.527694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122c51d-5f3e-4167-976c-9818452edea8 admin admin] PATH_INFO: `/v3/projects/43cc318f72ad4cb4a323f7dd7015639c/users/9179793ad9a749c6ad6b77697d6971bf/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.558516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122c51d-5f3e-4167-976c-9818452edea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cc318f72ad4cb4a323f7dd7015639c, user_id=9179793ad9a749c6ad6b77697d6971bf, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:53.561751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122c51d-5f3e-4167-976c-9818452edea8 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:53.587109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 873/1750] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:53.587109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a993d7-ab65-49b0-a375-6d773e1a7efb None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:53.592387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 878/1751] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:53 2022] PUT /identity/v3/projects/43cc318f72ad4cb4a323f7dd7015639c/users/9179793ad9a749c6ad6b77697d6971bf/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:53.593772 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944693-401a-4887-8e90-94a7fb47a027 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.594058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944693-401a-4887-8e90-94a7fb47a027 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.594379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944693-401a-4887-8e90-94a7fb47a027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.606179 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a993d7-ab65-49b0-a375-6d773e1a7efb None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:53.638763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-73944693-401a-4887-8e90-94a7fb47a027 None None] MFA Rules not processed for user `0319076e113748d4a86e5906559abdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:53.639980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-73944693-401a-4887-8e90-94a7fb47a027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:53.686577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:53.761177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 879/1752] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:53.770658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73944693-401a-4887-8e90-94a7fb47a027 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:53.783918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-73944693-401a-4887-8e90-94a7fb47a027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:53.828306 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2efb2-81dc-4894-a3d0-bc6854fd9c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:53.828946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2efb2-81dc-4894-a3d0-bc6854fd9c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.829221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2efb2-81dc-4894-a3d0-bc6854fd9c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.829498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2efb2-81dc-4894-a3d0-bc6854fd9c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.830313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2efb2-81dc-4894-a3d0-bc6854fd9c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:53.830796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2efb2-81dc-4894-a3d0-bc6854fd9c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:53.832491 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2efb2-81dc-4894-a3d0-bc6854fd9c95 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:53.867148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 874/1753] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:53.867854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676b36-98ff-4ffe-94c4-98bef3c58317 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:53.869347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676b36-98ff-4ffe-94c4-98bef3c58317 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:53.869347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676b36-98ff-4ffe-94c4-98bef3c58317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:53.904986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:53.909486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-bf676b36-98ff-4ffe-94c4-98bef3c58317 None None] MFA Rules not processed for user `3c921ff0cbca40c7944ae3fb77cc96b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:53.911338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bf676b36-98ff-4ffe-94c4-98bef3c58317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:53.991411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73944693-401a-4887-8e90-94a7fb47a027 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:54.015906 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:54.019370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:54.020353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:54.021521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:54.073697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 875/1754] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:54.079336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c075d-189b-4983-bce3-4b182e8eef37 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:54.079702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c075d-189b-4983-bce3-4b182e8eef37 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:54.080175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c075d-189b-4983-bce3-4b182e8eef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:54.178962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-947c075d-189b-4983-bce3-4b182e8eef37 None None] MFA Rules not processed for user `9179793ad9a749c6ad6b77697d6971bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:54.180239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-947c075d-189b-4983-bce3-4b182e8eef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:54.186439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:54.189649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:54.228279 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 880/1755] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:54.229378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:54.232231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:54.266546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bbc0c-7745-4a85-a713-2a54976da611 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:54.277978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb668-3787-4d32-b411-8a8698f7c607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:54.279538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb668-3787-4d32-b411-8a8698f7c607 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:54.282157 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb668-3787-4d32-b411-8a8698f7c607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:54.282815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb668-3787-4d32-b411-8a8698f7c607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:54.304048 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bb668-3787-4d32-b411-8a8698f7c607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:54.308297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bb668-3787-4d32-b411-8a8698f7c607 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:54.348235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 881/1756] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:54.351004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb668-3787-4d32-b411-8a8698f7c607 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:54.386106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 876/1757] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:54.387434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c075d-189b-4983-bce3-4b182e8eef37 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:54.389163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-947c075d-189b-4983-bce3-4b182e8eef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:54.409545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb668-3787-4d32-b411-8a8698f7c607 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:54.426426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:54.430549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:54.432073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:54.433998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:54.434616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:54.442343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c075d-189b-4983-bce3-4b182e8eef37 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:54.444254 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:54.462551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:54.464162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:54.464614 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:54.465058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] PATH_INFO: `/v3/projects/276f6dbada414c1f84a8a9ce5736037c` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:54.467945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276f6dbada414c1f84a8a9ce5736037c)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:54.471677 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:54.563835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 882/1758] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:54 2022] POST /identity/v3/projects => generated 355 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:54.585702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:54.594834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:54.602431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:54.617206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276f6dbada414c1f84a8a9ce5736037c', 'request_id': 'req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:54.636782 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276f6dbada414c1f84a8a9ce5736037c', 'request_id': 'req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:54.658647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276f6dbada414c1f84a8a9ce5736037c', 'request_id': 'req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:54.692444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] The token cache is being invalidate because project 276f6dbada414c1f84a8a9ce5736037c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:42:54.693851 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:54.695990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:42:54.698701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 877/1759] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:42:54 2022] DELETE /identity/v3/projects/276f6dbada414c1f84a8a9ce5736037c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:54.705397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:54.710213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:54.815466 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c7b3f-3665-4d62-8622-2e4b656cf65a admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:54.866335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:54.871177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbb9b-a0aa-4a44-ba70-e7bec31a1fa9 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:54.881252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:54.882019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:54.882465 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:54.882686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:54.883338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:54.886055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:54.912799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:54.913562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:54.913853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:54.914130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:54.916095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:54.959748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 878/1760] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:54 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:54.964499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:54.967384 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:55.040979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c695a-ba08-4137-a627-9df89eb13109 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.045725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d661a7-259b-4b1e-adc7-63b7e81c212b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.046408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d661a7-259b-4b1e-adc7-63b7e81c212b service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.046699 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d661a7-259b-4b1e-adc7-63b7e81c212b service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.046978 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d661a7-259b-4b1e-adc7-63b7e81c212b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.049106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-01d661a7-259b-4b1e-adc7-63b7e81c212b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:55.058158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.060815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.073893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 883/1761] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:55.075259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.077409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:55.094408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8a9c8-695b-4ccb-8f69-a0380ec4acf9 service nova] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.225230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d661a7-259b-4b1e-adc7-63b7e81c212b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.231445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d661a7-259b-4b1e-adc7-63b7e81c212b service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.274881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 879/1762] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:55.280012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5094c1-9c75-4151-922a-6fb70107c48c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.280310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5094c1-9c75-4151-922a-6fb70107c48c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.280596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5094c1-9c75-4151-922a-6fb70107c48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.299223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811418e-f1c7-4649-a07a-bf4654041318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.300428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811418e-f1c7-4649-a07a-bf4654041318 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.301037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811418e-f1c7-4649-a07a-bf4654041318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.301445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811418e-f1c7-4649-a07a-bf4654041318 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.302227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811418e-f1c7-4649-a07a-bf4654041318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.307480 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811418e-f1c7-4649-a07a-bf4654041318 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.349725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7d5094c1-9c75-4151-922a-6fb70107c48c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:55.355336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7d5094c1-9c75-4151-922a-6fb70107c48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:55.357743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 884/1763] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:55 2022] POST /identity/v3/users => generated 278 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:55.363135 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811418e-f1c7-4649-a07a-bf4654041318 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.388124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 880/1764] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:55.390532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5094c1-9c75-4151-922a-6fb70107c48c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.417983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811418e-f1c7-4649-a07a-bf4654041318 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.424163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:55.438110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5094c1-9c75-4151-922a-6fb70107c48c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.445804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917411-c17b-446c-98b8-56954a4b2782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.446999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917411-c17b-446c-98b8-56954a4b2782 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.447730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917411-c17b-446c-98b8-56954a4b2782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.448086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917411-c17b-446c-98b8-56954a4b2782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.449556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94917411-c17b-446c-98b8-56954a4b2782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.462187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94917411-c17b-446c-98b8-56954a4b2782 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.470458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68dbe4-f1a4-490e-a216-7ff81c1a80f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.474722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68dbe4-f1a4-490e-a216-7ff81c1a80f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.479234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68dbe4-f1a4-490e-a216-7ff81c1a80f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.479623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68dbe4-f1a4-490e-a216-7ff81c1a80f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.482383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68dbe4-f1a4-490e-a216-7ff81c1a80f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.493836 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68dbe4-f1a4-490e-a216-7ff81c1a80f2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.522740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 881/1765] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:55.525074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4924-e8df-49f8-bd14-f21518b5bf46 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.525527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4924-e8df-49f8-bd14-f21518b5bf46 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.525798 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4924-e8df-49f8-bd14-f21518b5bf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.574242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 885/1766] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:55 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:55.576828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68dbe4-f1a4-490e-a216-7ff81c1a80f2 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.601470 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3acf4924-e8df-49f8-bd14-f21518b5bf46 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:55.605883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3acf4924-e8df-49f8-bd14-f21518b5bf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:55.631472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 882/1767] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:55.636590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68dbe4-f1a4-490e-a216-7ff81c1a80f2 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.637134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf4924-e8df-49f8-bd14-f21518b5bf46 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.661378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17b8fd-d808-4f5c-9bc9-fa6f9bc0eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.662526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf4924-e8df-49f8-bd14-f21518b5bf46 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.677264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b53173-eb06-483a-8575-b5fa2e0a65ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.677976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b53173-eb06-483a-8575-b5fa2e0a65ae admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.678406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b53173-eb06-483a-8575-b5fa2e0a65ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.678497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b53173-eb06-483a-8575-b5fa2e0a65ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.679158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b53173-eb06-483a-8575-b5fa2e0a65ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.681611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b53173-eb06-483a-8575-b5fa2e0a65ae admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.693849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17b8fd-d808-4f5c-9bc9-fa6f9bc0eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.694847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17b8fd-d808-4f5c-9bc9-fa6f9bc0eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.695244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17b8fd-d808-4f5c-9bc9-fa6f9bc0eb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.696431 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17b8fd-d808-4f5c-9bc9-fa6f9bc0eb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.699845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17b8fd-d808-4f5c-9bc9-fa6f9bc0eb60 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.709013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 883/1768] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:55.709942 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b53173-eb06-483a-8575-b5fa2e0a65ae admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.744844 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b53173-eb06-483a-8575-b5fa2e0a65ae admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.766311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 886/1769] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:55.767543 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17b8fd-d808-4f5c-9bc9-fa6f9bc0eb60 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.770302 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.772201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.772656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.774105 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.779648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:42:55.780179 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.785427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.809150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17b8fd-d808-4f5c-9bc9-fa6f9bc0eb60 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.838271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05137e-7998-4196-91ed-e9e68e658ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.838968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05137e-7998-4196-91ed-e9e68e658ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.839255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05137e-7998-4196-91ed-e9e68e658ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.839529 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05137e-7998-4196-91ed-e9e68e658ad6 admin admin] PATH_INFO: `/v3/projects/77a29eda34af4eb3bf338115127aad98/users/c752f57bd1a34da783aac5798a13e032/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.844244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 884/1770] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:42:55.845874 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.866293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae633-199e-469f-a67e-147fb379feb7 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:55.871215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05137e-7998-4196-91ed-e9e68e658ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a29eda34af4eb3bf338115127aad98, user_id=c752f57bd1a34da783aac5798a13e032, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.877723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278af1-0742-4dce-9d37-020e7264cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:55.879088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278af1-0742-4dce-9d37-020e7264cd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:55.879391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05137e-7998-4196-91ed-e9e68e658ad6 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.879514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278af1-0742-4dce-9d37-020e7264cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:55.879783 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278af1-0742-4dce-9d37-020e7264cd5a admin admin] PATH_INFO: `/v3/projects/9a63be68ef9b49dca0cfa35e7eed46dc/users/1b86cd0eb2b64abc8b2484ec160bb7e6/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:55.911863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 887/1771] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:55 2022] PUT /identity/v3/projects/77a29eda34af4eb3bf338115127aad98/users/c752f57bd1a34da783aac5798a13e032/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:55.912780 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05137e-7998-4196-91ed-e9e68e658ad6 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:55.919475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10278af1-0742-4dce-9d37-020e7264cd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a63be68ef9b49dca0cfa35e7eed46dc, user_id=1b86cd0eb2b64abc8b2484ec160bb7e6, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:55.922685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10278af1-0742-4dce-9d37-020e7264cd5a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:55.927483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:55.989442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 885/1772] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:55 2022] PUT /identity/v3/projects/9a63be68ef9b49dca0cfa35e7eed46dc/users/1b86cd0eb2b64abc8b2484ec160bb7e6/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:55.996104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278af1-0742-4dce-9d37-020e7264cd5a admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:56.059194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05137e-7998-4196-91ed-e9e68e658ad6 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:56.194208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278af1-0742-4dce-9d37-020e7264cd5a admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:56.224130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5505ea-3a0f-41f6-96d9-46f03b1b3b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:56.224130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5505ea-3a0f-41f6-96d9-46f03b1b3b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:56.224130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5505ea-3a0f-41f6-96d9-46f03b1b3b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:56.224130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5505ea-3a0f-41f6-96d9-46f03b1b3b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:56.224654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5505ea-3a0f-41f6-96d9-46f03b1b3b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:56.224654 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5505ea-3a0f-41f6-96d9-46f03b1b3b6b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:56.225956 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518118b-f10f-49ae-9169-d8e592a33671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:56.226696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518118b-f10f-49ae-9169-d8e592a33671 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:56.227062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518118b-f10f-49ae-9169-d8e592a33671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:56.227427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518118b-f10f-49ae-9169-d8e592a33671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:56.228365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518118b-f10f-49ae-9169-d8e592a33671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:56.235665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518118b-f10f-49ae-9169-d8e592a33671 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:56.254591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 886/1773] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:56.260363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422a13-1a69-4570-94c6-51f966ee276b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:56.261671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422a13-1a69-4570-94c6-51f966ee276b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:56.261944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422a13-1a69-4570-94c6-51f966ee276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:56.314305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 888/1774] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:55 2022] POST /identity/v3/projects => generated 393 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:56.315285 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518118b-f10f-49ae-9169-d8e592a33671 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:56.343936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-27422a13-1a69-4570-94c6-51f966ee276b None None] MFA Rules not processed for user `1b86cd0eb2b64abc8b2484ec160bb7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:56.345193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-27422a13-1a69-4570-94c6-51f966ee276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:56.521771 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518118b-f10f-49ae-9169-d8e592a33671 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:56.526945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61452c-d162-44b2-ab36-4ce40ada34c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:56.527847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61452c-d162-44b2-ab36-4ce40ada34c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:56.528285 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61452c-d162-44b2-ab36-4ce40ada34c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:56.528700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61452c-d162-44b2-ab36-4ce40ada34c7 admin admin] PATH_INFO: `/v3/projects/77a29eda34af4eb3bf338115127aad98/users/c752f57bd1a34da783aac5798a13e032/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:56.532734 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61452c-d162-44b2-ab36-4ce40ada34c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a29eda34af4eb3bf338115127aad98, user_id=c752f57bd1a34da783aac5798a13e032, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:56.535573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61452c-d162-44b2-ab36-4ce40ada34c7 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:56.558703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 887/1775] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:56.559475 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 889/1776] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:56 2022] PUT /identity/v3/projects/77a29eda34af4eb3bf338115127aad98/users/c752f57bd1a34da783aac5798a13e032/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:56.561142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3ee4f-1676-4133-a3ae-68694c10b599 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:56.563283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3ee4f-1676-4133-a3ae-68694c10b599 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:56.563944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3ee4f-1676-4133-a3ae-68694c10b599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:56.572351 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422a13-1a69-4570-94c6-51f966ee276b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:56.595125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422a13-1a69-4570-94c6-51f966ee276b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:56.634794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:56.682953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-dea3ee4f-1676-4133-a3ae-68694c10b599 None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:56.684371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-dea3ee4f-1676-4133-a3ae-68694c10b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:56.703412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:56.745037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccfedd-3056-48b1-a547-ac693bb3a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:56.745676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccfedd-3056-48b1-a547-ac693bb3a73d admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:56.745958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccfedd-3056-48b1-a547-ac693bb3a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:56.746234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccfedd-3056-48b1-a547-ac693bb3a73d admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:56.746882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccfedd-3056-48b1-a547-ac693bb3a73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:56.749838 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccfedd-3056-48b1-a547-ac693bb3a73d admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:56.807084 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 888/1777] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:56 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:56.808031 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccfedd-3056-48b1-a547-ac693bb3a73d admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:56.861380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 890/1778] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:42:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:56.862731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cc744-3b1d-42d9-8fc7-72b15d2f1ca9 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:56.863033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cc744-3b1d-42d9-8fc7-72b15d2f1ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:56.863283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cc744-3b1d-42d9-8fc7-72b15d2f1ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:56.870302 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccfedd-3056-48b1-a547-ac693bb3a73d admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:56.900812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f4ba0-b918-4e0d-aa3b-294060fd62a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:56.901520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4ba0-b918-4e0d-aa3b-294060fd62a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:56.901812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4ba0-b918-4e0d-aa3b-294060fd62a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:56.902085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4ba0-b918-4e0d-aa3b-294060fd62a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:56.905293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f4ba0-b918-4e0d-aa3b-294060fd62a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:56.907389 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f4ba0-b918-4e0d-aa3b-294060fd62a3 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:56.980010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b50cc744-3b1d-42d9-8fc7-72b15d2f1ca9 None None] MFA Rules not processed for user `c752f57bd1a34da783aac5798a13e032`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:56.980410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b50cc744-3b1d-42d9-8fc7-72b15d2f1ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:57.034141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 889/1779] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:56 2022] POST /identity/v3/projects => generated 355 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:57.038289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f4ba0-b918-4e0d-aa3b-294060fd62a3 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:57.132535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 891/1780] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:57.133391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cc744-3b1d-42d9-8fc7-72b15d2f1ca9 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:57.148134 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cc744-3b1d-42d9-8fc7-72b15d2f1ca9 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:57.252689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f4ba0-b918-4e0d-aa3b-294060fd62a3 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:57.273566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e38348-5e91-4e5f-aee6-a849f4fd31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:57.274211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e38348-5e91-4e5f-aee6-a849f4fd31c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:57.274708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e38348-5e91-4e5f-aee6-a849f4fd31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:57.274994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e38348-5e91-4e5f-aee6-a849f4fd31c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:57.276103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e38348-5e91-4e5f-aee6-a849f4fd31c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:57.279407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e38348-5e91-4e5f-aee6-a849f4fd31c2 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:57.298888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:57.300155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:57.300445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:57.308110 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 890/1781] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:57.309098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e38348-5e91-4e5f-aee6-a849f4fd31c2 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:57.311741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:57.315218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:57.322998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:57.381336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 892/1782] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:57 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:57.382970 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:57.398017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:57.482556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:57.504547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e38348-5e91-4e5f-aee6-a849f4fd31c2 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:57.521936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:57.522583 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:57.523393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:57.523393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:57.530434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:57.651924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee938b3-a87a-4a2c-a05e-1d7a0eda43e2 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:57.670545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ebc71-9647-4dc9-aca7-bc32790e1ae5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:57.677609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebc71-9647-4dc9-aca7-bc32790e1ae5 service swift] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:57.677911 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebc71-9647-4dc9-aca7-bc32790e1ae5 service swift] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:57.678191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ebc71-9647-4dc9-aca7-bc32790e1ae5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:57.683012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:57.739634 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:57.741300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:57.766781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 891/1783] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:42:57.780281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:57.788517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ebc71-9647-4dc9-aca7-bc32790e1ae5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:57.790854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ebc71-9647-4dc9-aca7-bc32790e1ae5 service swift] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:57.810124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 893/1784] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:42:57.810814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ebc71-9647-4dc9-aca7-bc32790e1ae5 service swift] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:57.812388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f544f-d269-4159-b28d-8b676491d46e service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:57.844125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1336b-b5da-41d1-9c3a-23f48c1f9f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:57.846119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1336b-b5da-41d1-9c3a-23f48c1f9f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:57.847527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1336b-b5da-41d1-9c3a-23f48c1f9f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:57.848029 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1336b-b5da-41d1-9c3a-23f48c1f9f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:57.849740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1336b-b5da-41d1-9c3a-23f48c1f9f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:57.855265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1336b-b5da-41d1-9c3a-23f48c1f9f9e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:57.862548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ebc71-9647-4dc9-aca7-bc32790e1ae5 service swift] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:57.883544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 892/1785] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:57.890233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1336b-b5da-41d1-9c3a-23f48c1f9f9e admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:57.895060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e88f44-dd7e-42fa-8393-c14f4e798eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:57.903409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88f44-dd7e-42fa-8393-c14f4e798eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:57.903701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88f44-dd7e-42fa-8393-c14f4e798eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:57.905794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88f44-dd7e-42fa-8393-c14f4e798eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:57.908157 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e88f44-dd7e-42fa-8393-c14f4e798eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:57.909810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e88f44-dd7e-42fa-8393-c14f4e798eb2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:57.950706 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1336b-b5da-41d1-9c3a-23f48c1f9f9e admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:58.006186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d820543-097e-4882-bd17-19e70d01b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:58.011228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820543-097e-4882-bd17-19e70d01b098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:58.011502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820543-097e-4882-bd17-19e70d01b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:58.012479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820543-097e-4882-bd17-19e70d01b098 admin admin] PATH_INFO: `/v3/projects/4556a730618f4b9a9954b63506bf0a93/users/a09ea010a27c4f71a9dd78ea05d188fc/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:58.031701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 894/1786] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:58.033357 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3552c2-f342-4c2f-958a-e49aaf1face6 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:58.034039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3552c2-f342-4c2f-958a-e49aaf1face6 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:58.034039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3552c2-f342-4c2f-958a-e49aaf1face6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:58.079313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d820543-097e-4882-bd17-19e70d01b098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4556a730618f4b9a9954b63506bf0a93, user_id=a09ea010a27c4f71a9dd78ea05d188fc, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:58.083961 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d820543-097e-4882-bd17-19e70d01b098 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:58.136030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 893/1787] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:57 2022] PUT /identity/v3/projects/4556a730618f4b9a9954b63506bf0a93/users/a09ea010a27c4f71a9dd78ea05d188fc/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:58.139252 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d820543-097e-4882-bd17-19e70d01b098 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:58.153093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-0f3552c2-f342-4c2f-958a-e49aaf1face6 None None] MFA Rules not processed for user `3c921ff0cbca40c7944ae3fb77cc96b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:58.156732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-0f3552c2-f342-4c2f-958a-e49aaf1face6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:58.297109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 895/1788] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:58.299240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97666d5-b8d3-40c3-9d39-843b2e2bbc88 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:58.299551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97666d5-b8d3-40c3-9d39-843b2e2bbc88 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:58.299922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97666d5-b8d3-40c3-9d39-843b2e2bbc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:58.369505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f97666d5-b8d3-40c3-9d39-843b2e2bbc88 None None] MFA Rules not processed for user `a09ea010a27c4f71a9dd78ea05d188fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:58.370855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f97666d5-b8d3-40c3-9d39-843b2e2bbc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:58.420762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:58.494385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d820543-097e-4882-bd17-19e70d01b098 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:58.527532 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 896/1789] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:42:58.533408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97666d5-b8d3-40c3-9d39-843b2e2bbc88 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:58.541688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c25a0-7806-4911-be00-8080cd2506f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:58.543242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c25a0-7806-4911-be00-8080cd2506f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:58.544431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c25a0-7806-4911-be00-8080cd2506f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:58.544431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c25a0-7806-4911-be00-8080cd2506f5 admin admin] PATH_INFO: `/v3/projects/21ab96ce95ae491f933b70a502ef4477/users/7c8052c18bd8478db28980bbcc058485/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:58.566473 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97666d5-b8d3-40c3-9d39-843b2e2bbc88 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:58.578859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62652ad-b50a-47da-88f1-2d01ff07322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:58.580902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62652ad-b50a-47da-88f1-2d01ff07322b admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:58.581191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62652ad-b50a-47da-88f1-2d01ff07322b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:58.582151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62652ad-b50a-47da-88f1-2d01ff07322b admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:58.584280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62652ad-b50a-47da-88f1-2d01ff07322b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:58.605403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62652ad-b50a-47da-88f1-2d01ff07322b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:58.651480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c25a0-7806-4911-be00-8080cd2506f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ab96ce95ae491f933b70a502ef4477, user_id=7c8052c18bd8478db28980bbcc058485, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:58.662594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c25a0-7806-4911-be00-8080cd2506f5 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:58.701157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 894/1790] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:58 2022] PUT /identity/v3/projects/21ab96ce95ae491f933b70a502ef4477/users/7c8052c18bd8478db28980bbcc058485/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:58.702176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c25a0-7806-4911-be00-8080cd2506f5 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:58.770396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 897/1791] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:42:58 2022] POST /identity/v3/projects => generated 391 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:58.774711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62652ad-b50a-47da-88f1-2d01ff07322b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:58.905042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c25a0-7806-4911-be00-8080cd2506f5 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:58.967985 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:59.022761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62652ad-b50a-47da-88f1-2d01ff07322b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:59.033236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230ce1-1314-4d55-b79a-f52df865ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:59.033905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230ce1-1314-4d55-b79a-f52df865ed6d admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.034192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230ce1-1314-4d55-b79a-f52df865ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.034620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230ce1-1314-4d55-b79a-f52df865ed6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.035262 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d273-69b6-444e-ad29-f08478711f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:59.036679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230ce1-1314-4d55-b79a-f52df865ed6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:59.038042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d273-69b6-444e-ad29-f08478711f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.040569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d273-69b6-444e-ad29-f08478711f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.040569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d273-69b6-444e-ad29-f08478711f68 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.043098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230ce1-1314-4d55-b79a-f52df865ed6d admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:59.046712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6d273-69b6-444e-ad29-f08478711f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:59.055390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6d273-69b6-444e-ad29-f08478711f68 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:59.091382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 895/1792] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:59.093257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230ce1-1314-4d55-b79a-f52df865ed6d admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:59.106758 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 898/1793] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:42:58 2022] POST /identity/v3/users => generated 302 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:42:59.107752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d273-69b6-444e-ad29-f08478711f68 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:59.125571 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d273-69b6-444e-ad29-f08478711f68 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:59.156545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937db429-b34d-4a72-99b2-5281d8cdb63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:59.157374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937db429-b34d-4a72-99b2-5281d8cdb63b admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.158176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230ce1-1314-4d55-b79a-f52df865ed6d admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:59.171041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937db429-b34d-4a72-99b2-5281d8cdb63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.171343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937db429-b34d-4a72-99b2-5281d8cdb63b admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.172946 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937db429-b34d-4a72-99b2-5281d8cdb63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:59.175033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937db429-b34d-4a72-99b2-5281d8cdb63b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:59.175264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae4ad6-4b2a-4e03-afb9-a15a8efee99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:59.177059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae4ad6-4b2a-4e03-afb9-a15a8efee99a admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.177277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae4ad6-4b2a-4e03-afb9-a15a8efee99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.179485 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae4ad6-4b2a-4e03-afb9-a15a8efee99a admin admin] PATH_INFO: `/v3/projects/21ab96ce95ae491f933b70a502ef4477/users/7c8052c18bd8478db28980bbcc058485/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.185718 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae4ad6-4b2a-4e03-afb9-a15a8efee99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21ab96ce95ae491f933b70a502ef4477, user_id=7c8052c18bd8478db28980bbcc058485, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:59.194505 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae4ad6-4b2a-4e03-afb9-a15a8efee99a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:59.224357 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 899/1794] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:59.225789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937db429-b34d-4a72-99b2-5281d8cdb63b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:59.237802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 896/1795] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:59 2022] PUT /identity/v3/projects/21ab96ce95ae491f933b70a502ef4477/users/7c8052c18bd8478db28980bbcc058485/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:59.240249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38409-9567-4399-ad3a-3a9bc21f64ca None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.240598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38409-9567-4399-ad3a-3a9bc21f64ca None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.241018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38409-9567-4399-ad3a-3a9bc21f64ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.296311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937db429-b34d-4a72-99b2-5281d8cdb63b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:59.305105 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-68f38409-9567-4399-ad3a-3a9bc21f64ca None None] MFA Rules not processed for user `7c8052c18bd8478db28980bbcc058485`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:42:59.307016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-68f38409-9567-4399-ad3a-3a9bc21f64ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:42:59.428299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8e46-31bb-43fe-a252-a74071606332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:59.428995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8e46-31bb-43fe-a252-a74071606332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.429296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8e46-31bb-43fe-a252-a74071606332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.429552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8e46-31bb-43fe-a252-a74071606332 admin admin] PATH_INFO: `/v3/projects/8750597846114c188ecb83a03fe6955c/users/a4ad75488ed54fac9be03de8cc999fd3/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.468901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c8e46-31bb-43fe-a252-a74071606332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8750597846114c188ecb83a03fe6955c, user_id=a4ad75488ed54fac9be03de8cc999fd3, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:59.476212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 897/1796] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:42:59.482910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c8e46-31bb-43fe-a252-a74071606332 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:59.491472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38409-9567-4399-ad3a-3a9bc21f64ca None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:59.515861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 900/1797] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:59 2022] PUT /identity/v3/projects/8750597846114c188ecb83a03fe6955c/users/a4ad75488ed54fac9be03de8cc999fd3/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:59.520681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8e46-31bb-43fe-a252-a74071606332 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:59.557604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:42:59.733043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38409-9567-4399-ad3a-3a9bc21f64ca None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:59.765956 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8e46-31bb-43fe-a252-a74071606332 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:59.784736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4da98-6f5b-4688-abcf-f7d7f8c60df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:59.785467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4da98-6f5b-4688-abcf-f7d7f8c60df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.785680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4da98-6f5b-4688-abcf-f7d7f8c60df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.786033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4da98-6f5b-4688-abcf-f7d7f8c60df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.786688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4da98-6f5b-4688-abcf-f7d7f8c60df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:59.790114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4da98-6f5b-4688-abcf-f7d7f8c60df6 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:59.835619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 901/1798] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:42:59.836631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4da98-6f5b-4688-abcf-f7d7f8c60df6 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:42:59.862927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4da98-6f5b-4688-abcf-f7d7f8c60df6 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:42:59.884936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606965f6-ce8e-45e6-8118-f72c9eae7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:59.885649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606965f6-ce8e-45e6-8118-f72c9eae7b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.885948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606965f6-ce8e-45e6-8118-f72c9eae7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.886250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606965f6-ce8e-45e6-8118-f72c9eae7b76 admin admin] PATH_INFO: `/v3/projects/8750597846114c188ecb83a03fe6955c/users/a4ad75488ed54fac9be03de8cc999fd3/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.893418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606965f6-ce8e-45e6-8118-f72c9eae7b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8750597846114c188ecb83a03fe6955c, user_id=a4ad75488ed54fac9be03de8cc999fd3, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:42:59.900274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad1e32-7868-4361-8176-c6a1f72babaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:42:59.900870 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad1e32-7868-4361-8176-c6a1f72babaa service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.901242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad1e32-7868-4361-8176-c6a1f72babaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.901515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad1e32-7868-4361-8176-c6a1f72babaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.904141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606965f6-ce8e-45e6-8118-f72c9eae7b76 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:42:59.951326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 902/1799] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:42:59 2022] PUT /identity/v3/projects/8750597846114c188ecb83a03fe6955c/users/a4ad75488ed54fac9be03de8cc999fd3/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:42:59.953036 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0e0f-bdf9-400c-bcbe-180a2f51928d None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:42:59.953323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0e0f-bdf9-400c-bcbe-180a2f51928d None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:42:59.953599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0e0f-bdf9-400c-bcbe-180a2f51928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:42:59.958665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:00.060326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-032a0e0f-bdf9-400c-bcbe-180a2f51928d None None] MFA Rules not processed for user `a4ad75488ed54fac9be03de8cc999fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:00.061546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-032a0e0f-bdf9-400c-bcbe-180a2f51928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:00.140391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad1e32-7868-4361-8176-c6a1f72babaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:00.145936 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad1e32-7868-4361-8176-c6a1f72babaa service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:00.194844 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 898/1800] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:42:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:00.367846 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 903/1801] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:42:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:00.520127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad1e32-7868-4361-8176-c6a1f72babaa service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:00.529655 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad1e32-7868-4361-8176-c6a1f72babaa service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:00.701789 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309866a2-a36c-4df4-8f80-76c770e25d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:00.703017 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309866a2-a36c-4df4-8f80-76c770e25d82 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:00.703460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309866a2-a36c-4df4-8f80-76c770e25d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:00.704192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309866a2-a36c-4df4-8f80-76c770e25d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:00.732795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309866a2-a36c-4df4-8f80-76c770e25d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:00.759197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309866a2-a36c-4df4-8f80-76c770e25d82 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:00.781876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 899/1802] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:00.942256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0e0f-bdf9-400c-bcbe-180a2f51928d None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:00.943727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-032a0e0f-bdf9-400c-bcbe-180a2f51928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:00.965861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0e0f-bdf9-400c-bcbe-180a2f51928d None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:00.971087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b29e8a-8c56-48e2-9ca7-3978b3a8b64c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:00.972082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b29e8a-8c56-48e2-9ca7-3978b3a8b64c service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:00.972564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b29e8a-8c56-48e2-9ca7-3978b3a8b64c service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:00.972848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b29e8a-8c56-48e2-9ca7-3978b3a8b64c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:01.070426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b29e8a-8c56-48e2-9ca7-3978b3a8b64c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:01.074317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b29e8a-8c56-48e2-9ca7-3978b3a8b64c service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:01.099355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 904/1803] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:01.191902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309866a2-a36c-4df4-8f80-76c770e25d82 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:01.217091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309866a2-a36c-4df4-8f80-76c770e25d82 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:01.222346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5322d6-2f57-474c-b79a-71ec7826518a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:01.223699 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5322d6-2f57-474c-b79a-71ec7826518a service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:01.224171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5322d6-2f57-474c-b79a-71ec7826518a service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:01.224392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5322d6-2f57-474c-b79a-71ec7826518a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:01.367270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5322d6-2f57-474c-b79a-71ec7826518a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:01.373316 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5322d6-2f57-474c-b79a-71ec7826518a service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:01.404432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 900/1804] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:07.718810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b29e8a-8c56-48e2-9ca7-3978b3a8b64c service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:07.728060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b29e8a-8c56-48e2-9ca7-3978b3a8b64c service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:07.739610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:07.740665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:07.741243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:07.741715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:07.771284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:07.866203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:07.868395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:07.879655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 905/1805] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:11.390483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=76 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:12.559976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6ddc-b0c8-4a2e-88e0-2517e1c608d5 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:12.560883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6ddc-b0c8-4a2e-88e0-2517e1c608d5 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:12.561331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6ddc-b0c8-4a2e-88e0-2517e1c608d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:12.587068 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-1c4c6ddc-b0c8-4a2e-88e0-2517e1c608d5 None None] MFA Rules not processed for user `0319076e113748d4a86e5906559abdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:12.588643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1c4c6ddc-b0c8-4a2e-88e0-2517e1c608d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:12.657435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 901/1806] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Sep 1 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:12.797975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:12.799802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:12.812960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7b706-2d88-4a06-9111-2019cd3ab086 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:12.813658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c6ddc-b0c8-4a2e-88e0-2517e1c608d5 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:12.816816 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35463df-629f-4268-afac-dd4ad7c6d414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:12.817447 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35463df-629f-4268-afac-dd4ad7c6d414 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:12.817731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35463df-629f-4268-afac-dd4ad7c6d414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:12.818005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35463df-629f-4268-afac-dd4ad7c6d414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:12.825286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c6ddc-b0c8-4a2e-88e0-2517e1c608d5 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:12.826469 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35463df-629f-4268-afac-dd4ad7c6d414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:12.827969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35463df-629f-4268-afac-dd4ad7c6d414 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:12.831114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b63a9-ee5a-44a5-a036-428d4e540849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:12.832397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b63a9-ee5a-44a5-a036-428d4e540849 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:12.832678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b63a9-ee5a-44a5-a036-428d4e540849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:12.833115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b63a9-ee5a-44a5-a036-428d4e540849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:12.839379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 906/1807] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:12.840318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35463df-629f-4268-afac-dd4ad7c6d414 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:12.851183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35463df-629f-4268-afac-dd4ad7c6d414 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:12.854669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b63a9-ee5a-44a5-a036-428d4e540849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:12.856213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526dee8-73d7-4dfa-ad6f-1ee85566e4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:12.856349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b63a9-ee5a-44a5-a036-428d4e540849 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:12.857018 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526dee8-73d7-4dfa-ad6f-1ee85566e4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:12.858265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526dee8-73d7-4dfa-ad6f-1ee85566e4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:12.858668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526dee8-73d7-4dfa-ad6f-1ee85566e4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:12.867668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 902/1808] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:12.868056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526dee8-73d7-4dfa-ad6f-1ee85566e4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:12.869510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526dee8-73d7-4dfa-ad6f-1ee85566e4d6 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:12.878648 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 907/1809] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:13.739799 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b63a9-ee5a-44a5-a036-428d4e540849 service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:13.882145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b63a9-ee5a-44a5-a036-428d4e540849 service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:13.889340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:13.890485 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:13.890905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:13.891483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] PATH_INFO: `/v3/users/a09ea010a27c4f71a9dd78ea05d188fc` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:13.893338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09ea010a27c4f71a9dd78ea05d188fc)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:13.896728 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:13.951832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09ea010a27c4f71a9dd78ea05d188fc'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:13.961059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09ea010a27c4f71a9dd78ea05d188fc'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:13.970672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09ea010a27c4f71a9dd78ea05d188fc'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:13.971796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09ea010a27c4f71a9dd78ea05d188fc'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:13.986185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09ea010a27c4f71a9dd78ea05d188fc'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:13.994644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 903/1810] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:13 2022] DELETE /identity/v3/users/a09ea010a27c4f71a9dd78ea05d188fc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:13.999203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af439e1-e598-4e6f-b3a4-d2f4b8f8d812 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:13.999718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af439e1-e598-4e6f-b3a4-d2f4b8f8d812 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:13.999865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af439e1-e598-4e6f-b3a4-d2f4b8f8d812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:14.050641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-8af439e1-e598-4e6f-b3a4-d2f4b8f8d812 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:14.052601 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8af439e1-e598-4e6f-b3a4-d2f4b8f8d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:14.142399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 908/1811] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:14.217147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:14.218836 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:14.286545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:14.449823 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4758f84-1085-42cf-b24b-90e9b5138ffb admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:14.470125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198afe9c-3d87-4ac4-be2d-0f76f4d14958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:14.470688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198afe9c-3d87-4ac4-be2d-0f76f4d14958 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:14.470968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198afe9c-3d87-4ac4-be2d-0f76f4d14958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:14.471240 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198afe9c-3d87-4ac4-be2d-0f76f4d14958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:14.500629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198afe9c-3d87-4ac4-be2d-0f76f4d14958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:14.502157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198afe9c-3d87-4ac4-be2d-0f76f4d14958 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:14.529311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 904/1812] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:15.192083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ed6a-414c-4d4f-a0f4-b025b32d8715 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:15.192996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ed6a-414c-4d4f-a0f4-b025b32d8715 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:15.193423 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ed6a-414c-4d4f-a0f4-b025b32d8715 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:15.195285 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 909/1813] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:43:15.221913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107be5-cb22-4b4a-820b-0304c84b7609 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:15.222450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107be5-cb22-4b4a-820b-0304c84b7609 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:15.222450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107be5-cb22-4b4a-820b-0304c84b7609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:15.251544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-ad107be5-cb22-4b4a-820b-0304c84b7609 None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:15.253369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ad107be5-cb22-4b4a-820b-0304c84b7609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:15.403611 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 905/1814] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:43:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:15.460102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071afea-2226-4854-bf32-de2e29499f54 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:15.460379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071afea-2226-4854-bf32-de2e29499f54 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:15.460824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071afea-2226-4854-bf32-de2e29499f54 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:15.462723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 910/1815] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:43:15.474653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4c0b-f67c-4be2-ba4f-c9c97db0bdd4 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:15.475189 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4c0b-f67c-4be2-ba4f-c9c97db0bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:15.475726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4c0b-f67c-4be2-ba4f-c9c97db0bdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:15.506134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d89d4c0b-f67c-4be2-ba4f-c9c97db0bdd4 None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:15.508521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d89d4c0b-f67c-4be2-ba4f-c9c97db0bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:15.520219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 906/1816] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:43:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:15.676945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071afea-2226-4854-bf32-de2e29499f54 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:15.680576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-a071afea-2226-4854-bf32-de2e29499f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:15.713709 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071afea-2226-4854-bf32-de2e29499f54 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:15.729667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:15.732548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:15.732845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:15.733259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:15.757012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4c0b-f67c-4be2-ba4f-c9c97db0bdd4 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:15.757402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:15.759070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d89d4c0b-f67c-4be2-ba4f-c9c97db0bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:15.759556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:15.781108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 911/1817] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:15.782291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:15.783910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:15.797790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4c0b-f67c-4be2-ba4f-c9c97db0bdd4 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:15.816392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:15.817462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:15.818063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:15.818430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] PATH_INFO: `/v3/projects/4556a730618f4b9a9954b63506bf0a93` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:15.819934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4556a730618f4b9a9954b63506bf0a93)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:15.823326 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:15.823542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172256-b3b6-4fa3-8550-926ea1f6295a service nova] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:15.830494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f437af-0e1c-4d2e-be4b-470e6924ae0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:15.831246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f437af-0e1c-4d2e-be4b-470e6924ae0c service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:15.832187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f437af-0e1c-4d2e-be4b-470e6924ae0c service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:15.832476 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f437af-0e1c-4d2e-be4b-470e6924ae0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:15.854869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f437af-0e1c-4d2e-be4b-470e6924ae0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:15.856642 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f437af-0e1c-4d2e-be4b-470e6924ae0c service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:15.870943 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 912/1818] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:15.930248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4556a730618f4b9a9954b63506bf0a93', 'request_id': 'req-55978e32-23a6-4e6e-8877-d18dbc5d6eef'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:15.937579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4556a730618f4b9a9954b63506bf0a93', 'request_id': 'req-55978e32-23a6-4e6e-8877-d18dbc5d6eef'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:15.954192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4556a730618f4b9a9954b63506bf0a93', 'request_id': 'req-55978e32-23a6-4e6e-8877-d18dbc5d6eef'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:15.981502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] The token cache is being invalidate because project 4556a730618f4b9a9954b63506bf0a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:15.981841 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:15.982549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:15.984635 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 907/1819] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:15 2022] DELETE /identity/v3/projects/4556a730618f4b9a9954b63506bf0a93 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:15.988623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f437af-0e1c-4d2e-be4b-470e6924ae0c service nova] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:16.000622 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f437af-0e1c-4d2e-be4b-470e6924ae0c service nova] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:16.039358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:16.041086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:16.059471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:16.069714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:16.072394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.072869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.073159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] PATH_INFO: `/v3/users/a4ad75488ed54fac9be03de8cc999fd3` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.074425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ad75488ed54fac9be03de8cc999fd3)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:16.076607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:16.080976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:16.134404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ad75488ed54fac9be03de8cc999fd3'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.135066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ad75488ed54fac9be03de8cc999fd3'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.137744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55978e32-23a6-4e6e-8877-d18dbc5d6eef admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:16.144069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ad75488ed54fac9be03de8cc999fd3'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.144827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ad75488ed54fac9be03de8cc999fd3'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.145695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:16.146410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.146905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.147258 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] PATH_INFO: `/v3/users/66d7fa9a35294822b02de1dec8f162bf` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.150549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d7fa9a35294822b02de1dec8f162bf)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:16.152394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:16.154851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-8eb3f932-5843-4b52-b8a6-854f7a588f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ad75488ed54fac9be03de8cc999fd3'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.176306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 913/1820] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:15 2022] DELETE /identity/v3/users/a4ad75488ed54fac9be03de8cc999fd3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:16.210889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d7fa9a35294822b02de1dec8f162bf'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.219889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d7fa9a35294822b02de1dec8f162bf'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.232497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d7fa9a35294822b02de1dec8f162bf'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.234150 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d7fa9a35294822b02de1dec8f162bf'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.252922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d7fa9a35294822b02de1dec8f162bf'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.260412 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 908/1821] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:16 2022] DELETE /identity/v3/users/66d7fa9a35294822b02de1dec8f162bf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:16.265032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2e12-f4d3-44de-98f8-e0f18dba1e66 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.265551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2e12-f4d3-44de-98f8-e0f18dba1e66 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.265661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2e12-f4d3-44de-98f8-e0f18dba1e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.285000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c82c2e12-f4d3-44de-98f8-e0f18dba1e66 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:16.286618 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c82c2e12-f4d3-44de-98f8-e0f18dba1e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:16.385606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 914/1822] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:16.397578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:16.399303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:16.472689 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c8a9-e650-4aab-b7ae-a4d3f00b6382 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:16.479918 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66230f08-9898-45fe-93f0-bee616c09186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:16.484952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230f08-9898-45fe-93f0-bee616c09186 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.487286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230f08-9898-45fe-93f0-bee616c09186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.487582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66230f08-9898-45fe-93f0-bee616c09186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.502135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66230f08-9898-45fe-93f0-bee616c09186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:16.504546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66230f08-9898-45fe-93f0-bee616c09186 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:16.508313 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2e12-f4d3-44de-98f8-e0f18dba1e66 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:16.509761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c82c2e12-f4d3-44de-98f8-e0f18dba1e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:16.520086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 909/1823] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:16.525892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2e12-f4d3-44de-98f8-e0f18dba1e66 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:16.543540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:16.544825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.545232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.545613 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] PATH_INFO: `/v3/projects/8750597846114c188ecb83a03fe6955c` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.547206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8750597846114c188ecb83a03fe6955c)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:16.550172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:16.655424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8750597846114c188ecb83a03fe6955c', 'request_id': 'req-47b2242d-8d9d-4d87-a7da-879f7a3cffca'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.666093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8750597846114c188ecb83a03fe6955c', 'request_id': 'req-47b2242d-8d9d-4d87-a7da-879f7a3cffca'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.677540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8750597846114c188ecb83a03fe6955c', 'request_id': 'req-47b2242d-8d9d-4d87-a7da-879f7a3cffca'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.690174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:16.696366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] The token cache is being invalidate because project 8750597846114c188ecb83a03fe6955c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:16.697158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.698610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-47b2242d-8d9d-4d87-a7da-879f7a3cffca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:16.702249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 915/1824] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:16 2022] DELETE /identity/v3/projects/8750597846114c188ecb83a03fe6955c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:16.707283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38cf94-9fc1-4603-8d75-3809f6b8d0bc None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.707582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38cf94-9fc1-4603-8d75-3809f6b8d0bc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.707902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38cf94-9fc1-4603-8d75-3809f6b8d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.730912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-4b38cf94-9fc1-4603-8d75-3809f6b8d0bc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:16.732283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4b38cf94-9fc1-4603-8d75-3809f6b8d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:16.801959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:16.826867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 910/1825] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:16.835542 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2f1b-ced4-4163-8e98-5c66f5068455 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.835862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2f1b-ced4-4163-8e98-5c66f5068455 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.836824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d2f1b-ced4-4163-8e98-5c66f5068455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.860794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6a3d2f1b-ced4-4163-8e98-5c66f5068455 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:16.862575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6a3d2f1b-ced4-4163-8e98-5c66f5068455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:16.882706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 916/1826] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:16.887547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38cf94-9fc1-4603-8d75-3809f6b8d0bc None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:16.897675 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38cf94-9fc1-4603-8d75-3809f6b8d0bc None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:16.904225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:16.904447 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.904732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.905003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.905660 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:16.905959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:16.907561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:16.923686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 911/1827] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:43:16.925120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2f1b-ced4-4163-8e98-5c66f5068455 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:16.935326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d2f1b-ced4-4163-8e98-5c66f5068455 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:16.940325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acf0ff-357e-47d2-9b24-5f63d22d6f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:16.941026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf0ff-357e-47d2-9b24-5f63d22d6f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:16.941319 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf0ff-357e-47d2-9b24-5f63d22d6f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:16.941677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acf0ff-357e-47d2-9b24-5f63d22d6f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:16.942335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acf0ff-357e-47d2-9b24-5f63d22d6f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:16.944368 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acf0ff-357e-47d2-9b24-5f63d22d6f2b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:16.973883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:16.977794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:16.996347 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 917/1828] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:16 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:16.999041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fdf50-0754-4235-b5ff-5e2127ca9be1 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.000691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acf0ff-357e-47d2-9b24-5f63d22d6f2b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.059397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.060066 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.060347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.060624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] PATH_INFO: `/v3/projects/0a5f664054064fce9d1790d723c0c550` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.061757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5f664054064fce9d1790d723c0c550)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.062076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acf0ff-357e-47d2-9b24-5f63d22d6f2b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.063739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.066681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80f146-6d86-49c0-97e3-23bd2210ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.067286 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80f146-6d86-49c0-97e3-23bd2210ec93 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.067565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80f146-6d86-49c0-97e3-23bd2210ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.067872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80f146-6d86-49c0-97e3-23bd2210ec93 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.068498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80f146-6d86-49c0-97e3-23bd2210ec93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.070969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80f146-6d86-49c0-97e3-23bd2210ec93 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.093489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 918/1829] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:16 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:17.097751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80f146-6d86-49c0-97e3-23bd2210ec93 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.107917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80f146-6d86-49c0-97e3-23bd2210ec93 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.114481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5f664054064fce9d1790d723c0c550', 'request_id': 'req-483d6aec-1289-4ac5-979d-643891b465dd'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.121444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5f664054064fce9d1790d723c0c550', 'request_id': 'req-483d6aec-1289-4ac5-979d-643891b465dd'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.130069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5f664054064fce9d1790d723c0c550', 'request_id': 'req-483d6aec-1289-4ac5-979d-643891b465dd'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.146933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] The token cache is being invalidate because project 0a5f664054064fce9d1790d723c0c550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:17.147154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.147923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.149996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 912/1830] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:16 2022] DELETE /identity/v3/projects/0a5f664054064fce9d1790d723c0c550 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:17.155142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.156629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:17.184261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.185160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.185518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.185865 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.186647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.188674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.205612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 919/1831] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:17.209567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.212966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:17.226301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbcaff-015e-40f3-9257-670f6b9c257f admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.231192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eea6f-5e87-4c86-9d46-8b4d2fd5377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.231499 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d6aec-1289-4ac5-979d-643891b465dd admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.231821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eea6f-5e87-4c86-9d46-8b4d2fd5377a admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.232107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eea6f-5e87-4c86-9d46-8b4d2fd5377a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.232407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eea6f-5e87-4c86-9d46-8b4d2fd5377a admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.233007 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eea6f-5e87-4c86-9d46-8b4d2fd5377a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.234609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eea6f-5e87-4c86-9d46-8b4d2fd5377a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.236757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.237917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.238201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.238482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] PATH_INFO: `/v3/users/a04efabd74cc492593d526b6d5a0cc41` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.239651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04efabd74cc492593d526b6d5a0cc41)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.241601 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.247813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 920/1832] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:17.248474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:17.252495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eea6f-5e87-4c86-9d46-8b4d2fd5377a admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.264730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eea6f-5e87-4c86-9d46-8b4d2fd5377a admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.275241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c7ec5-bdfe-4b7f-969c-3bccc7e6428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.276102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7ec5-bdfe-4b7f-969c-3bccc7e6428d admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.276399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7ec5-bdfe-4b7f-969c-3bccc7e6428d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.276719 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7ec5-bdfe-4b7f-969c-3bccc7e6428d admin admin] PATH_INFO: `/v3/projects/7f60af1b029a40b388682ec171fcd7b1/users/265b03f5bb6e45e198fb1f32d9ce92aa/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.302298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04efabd74cc492593d526b6d5a0cc41'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.303876 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c7ec5-bdfe-4b7f-969c-3bccc7e6428d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f60af1b029a40b388682ec171fcd7b1, user_id=265b03f5bb6e45e198fb1f32d9ce92aa, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.307486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c7ec5-bdfe-4b7f-969c-3bccc7e6428d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.309916 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04efabd74cc492593d526b6d5a0cc41'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.317627 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04efabd74cc492593d526b6d5a0cc41'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.318278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04efabd74cc492593d526b6d5a0cc41'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.321374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 921/1833] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:17 2022] PUT /identity/v3/projects/7f60af1b029a40b388682ec171fcd7b1/users/265b03f5bb6e45e198fb1f32d9ce92aa/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:17.331410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3a36f-db33-409f-803b-a2f9e6419dae None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.331561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04efabd74cc492593d526b6d5a0cc41'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.331698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3a36f-db33-409f-803b-a2f9e6419dae None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.332041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3a36f-db33-409f-803b-a2f9e6419dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.337387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 913/1834] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:17 2022] DELETE /identity/v3/users/a04efabd74cc492593d526b6d5a0cc41 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:17.359124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-d6e3a36f-db33-409f-803b-a2f9e6419dae None None] MFA Rules not processed for user `265b03f5bb6e45e198fb1f32d9ce92aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:17.360351 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d6e3a36f-db33-409f-803b-a2f9e6419dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:17.370132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:17.428160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 922/1835] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:17.433468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.435284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:17.510850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f4c98-a9da-435b-a1b4-545428c0fa73 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.517000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.517621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.517914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.518191 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.518827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.520765 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.547340 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 914/1836] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:17 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:17.551429 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3a36f-db33-409f-803b-a2f9e6419dae None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.562636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3a36f-db33-409f-803b-a2f9e6419dae None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.615428 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.617761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:17.626650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853016a-ccc5-46c3-b345-b3bfe7c549c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.627379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853016a-ccc5-46c3-b345-b3bfe7c549c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.627763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853016a-ccc5-46c3-b345-b3bfe7c549c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.628209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853016a-ccc5-46c3-b345-b3bfe7c549c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.628948 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853016a-ccc5-46c3-b345-b3bfe7c549c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.631037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853016a-ccc5-46c3-b345-b3bfe7c549c6 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.660397 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 923/1837] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:17 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:17.664930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853016a-ccc5-46c3-b345-b3bfe7c549c6 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.676081 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853016a-ccc5-46c3-b345-b3bfe7c549c6 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.682009 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d32bb-d4c5-4608-be86-6148345ae0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.682766 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d32bb-d4c5-4608-be86-6148345ae0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.683055 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d32bb-d4c5-4608-be86-6148345ae0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.683447 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d32bb-d4c5-4608-be86-6148345ae0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.684382 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d32bb-d4c5-4608-be86-6148345ae0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.686130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d32bb-d4c5-4608-be86-6148345ae0b5 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.698510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 924/1838] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:17.702965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d32bb-d4c5-4608-be86-6148345ae0b5 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.721259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d32bb-d4c5-4608-be86-6148345ae0b5 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.724183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a5b9-453b-45fc-b218-0ead46f39010 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.729942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4e81-62c4-4009-85b7-909a81072fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.730538 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.730658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4e81-62c4-4009-85b7-909a81072fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.730975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4e81-62c4-4009-85b7-909a81072fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.731488 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.731603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4e81-62c4-4009-85b7-909a81072fe1 admin admin] PATH_INFO: `/v3/projects/daa02be3b9ef4d988cdbb83649795d1e/users/077bc4e872c5432789cf96a663144ea2/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.732072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.732393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] PATH_INFO: `/v3/projects/59e22ae1ad3247b7a08d92f3d451c910` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.735356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e22ae1ad3247b7a08d92f3d451c910)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.739163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.755406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4e81-62c4-4009-85b7-909a81072fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa02be3b9ef4d988cdbb83649795d1e, user_id=077bc4e872c5432789cf96a663144ea2, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.756294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:17.760053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4e81-62c4-4009-85b7-909a81072fe1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.791952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 925/1839] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:17 2022] PUT /identity/v3/projects/daa02be3b9ef4d988cdbb83649795d1e/users/077bc4e872c5432789cf96a663144ea2/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:17.793515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4e81-62c4-4009-85b7-909a81072fe1 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.807321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e22ae1ad3247b7a08d92f3d451c910', 'request_id': 'req-88188709-3911-4c3c-a7f6-a696bcc7273a'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.813750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e22ae1ad3247b7a08d92f3d451c910', 'request_id': 'req-88188709-3911-4c3c-a7f6-a696bcc7273a'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.823123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e22ae1ad3247b7a08d92f3d451c910', 'request_id': 'req-88188709-3911-4c3c-a7f6-a696bcc7273a'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.836353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] The token cache is being invalidate because project 59e22ae1ad3247b7a08d92f3d451c910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:17.836732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.837464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-88188709-3911-4c3c-a7f6-a696bcc7273a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:17.839128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 915/1840] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:17 2022] DELETE /identity/v3/projects/59e22ae1ad3247b7a08d92f3d451c910 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:17.844072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25a39-d91c-488d-b0ea-63babb275c56 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.844457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25a39-d91c-488d-b0ea-63babb275c56 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.844658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25a39-d91c-488d-b0ea-63babb275c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.861238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4e81-62c4-4009-85b7-909a81072fe1 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:17.864752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-92a25a39-d91c-488d-b0ea-63babb275c56 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:17.865943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-92a25a39-d91c-488d-b0ea-63babb275c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:17.871562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:17.943881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 916/1841] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:17.947292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262656-9ff7-4a90-97a2-9ebc75fa8da1 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.947581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262656-9ff7-4a90-97a2-9ebc75fa8da1 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.947890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84262656-9ff7-4a90-97a2-9ebc75fa8da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.957560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:17.958500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:17.958790 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:17.959060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:17.959711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:17.961749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:17.977274 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 926/1842] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:17.977890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-84262656-9ff7-4a90-97a2-9ebc75fa8da1 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:17.977890 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-84262656-9ff7-4a90-97a2-9ebc75fa8da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:17.978824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.981338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:17.985756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 917/1843] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:17.989633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84262656-9ff7-4a90-97a2-9ebc75fa8da1 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:17.995061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd5595-0eb5-43e4-8503-1d6c1c0b02a5 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.000972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1812f-f6af-409e-aae7-e26425ba8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.001774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1812f-f6af-409e-aae7-e26425ba8ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.002125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1812f-f6af-409e-aae7-e26425ba8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.002513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1812f-f6af-409e-aae7-e26425ba8ad4 admin admin] PATH_INFO: `/v3/projects/daa02be3b9ef4d988cdbb83649795d1e/users/077bc4e872c5432789cf96a663144ea2/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.004682 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1812f-f6af-409e-aae7-e26425ba8ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa02be3b9ef4d988cdbb83649795d1e, user_id=077bc4e872c5432789cf96a663144ea2, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.005960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84262656-9ff7-4a90-97a2-9ebc75fa8da1 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.008230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1812f-f6af-409e-aae7-e26425ba8ad4 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.012639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.013592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.013881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.014159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.014819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:18.015127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.017255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.021491 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 927/1844] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:17 2022] PUT /identity/v3/projects/daa02be3b9ef4d988cdbb83649795d1e/users/077bc4e872c5432789cf96a663144ea2/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:18.032041 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556eb1-5707-4fa7-a4e2-5ccccb55a168 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.032420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556eb1-5707-4fa7-a4e2-5ccccb55a168 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.032766 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556eb1-5707-4fa7-a4e2-5ccccb55a168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.043150 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 918/1845] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:43:18.046325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.059382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738527-d640-4c97-bf74-5dadf073f3ac admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.069334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c8556eb1-5707-4fa7-a4e2-5ccccb55a168 None None] MFA Rules not processed for user `077bc4e872c5432789cf96a663144ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:18.070640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c8556eb1-5707-4fa7-a4e2-5ccccb55a168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:18.137405 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9d8ae-0b39-4075-a070-227d6e63f047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.138056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9d8ae-0b39-4075-a070-227d6e63f047 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.138342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9d8ae-0b39-4075-a070-227d6e63f047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.138618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9d8ae-0b39-4075-a070-227d6e63f047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.139283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9d8ae-0b39-4075-a070-227d6e63f047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.141226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9d8ae-0b39-4075-a070-227d6e63f047 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.160483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 928/1846] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:18.184858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556eb1-5707-4fa7-a4e2-5ccccb55a168 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.186352 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c8556eb1-5707-4fa7-a4e2-5ccccb55a168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:18.187686 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 919/1847] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:18 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:18.194651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9d8ae-0b39-4075-a070-227d6e63f047 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.204619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:18.257105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556eb1-5707-4fa7-a4e2-5ccccb55a168 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.263089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9d8ae-0b39-4075-a070-227d6e63f047 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.268000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fea6b-1df1-41c0-9552-75005f7eacd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.268616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fea6b-1df1-41c0-9552-75005f7eacd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.268892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fea6b-1df1-41c0-9552-75005f7eacd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.269219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fea6b-1df1-41c0-9552-75005f7eacd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.269858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fea6b-1df1-41c0-9552-75005f7eacd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.271761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fea6b-1df1-41c0-9552-75005f7eacd4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.292415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:18.298894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 920/1848] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:18 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:18.300408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fea6b-1df1-41c0-9552-75005f7eacd4 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.311615 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fea6b-1df1-41c0-9552-75005f7eacd4 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.315573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ca6f-6891-451d-b2ef-a5ee9916fa34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.316299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ca6f-6891-451d-b2ef-a5ee9916fa34 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.316394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc648-296e-42c9-b099-ceae4e98e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.316510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ca6f-6891-451d-b2ef-a5ee9916fa34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.316744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ca6f-6891-451d-b2ef-a5ee9916fa34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.316859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc648-296e-42c9-b099-ceae4e98e0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.317150 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc648-296e-42c9-b099-ceae4e98e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.317423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc648-296e-42c9-b099-ceae4e98e0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.318063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc648-296e-42c9-b099-ceae4e98e0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.319739 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcc648-296e-42c9-b099-ceae4e98e0c9 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.330806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 921/1849] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:18.334933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc648-296e-42c9-b099-ceae4e98e0c9 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.360717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc648-296e-42c9-b099-ceae4e98e0c9 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.381824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4a703-1b32-4ba1-ae92-d42f2299df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.382685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4a703-1b32-4ba1-ae92-d42f2299df83 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.383493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4a703-1b32-4ba1-ae92-d42f2299df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.383787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4a703-1b32-4ba1-ae92-d42f2299df83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.385914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4a703-1b32-4ba1-ae92-d42f2299df83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.388239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4a703-1b32-4ba1-ae92-d42f2299df83 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.406935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 922/1850] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:18.408623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4a703-1b32-4ba1-ae92-d42f2299df83 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.411578 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5ca6f-6891-451d-b2ef-a5ee9916fa34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.414643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5ca6f-6891-451d-b2ef-a5ee9916fa34 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.419572 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4a703-1b32-4ba1-ae92-d42f2299df83 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.427897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7dd81-b970-41a8-b264-88be1a672c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.429115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 929/1851] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:18.439984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7dd81-b970-41a8-b264-88be1a672c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.448608 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7dd81-b970-41a8-b264-88be1a672c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.449519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7dd81-b970-41a8-b264-88be1a672c78 admin admin] PATH_INFO: `/v3/projects/671097d8f7ce4337be3ab06e975819e3/users/648c15c2c7d7418eb78efd52748f5572/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.476791 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7dd81-b970-41a8-b264-88be1a672c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671097d8f7ce4337be3ab06e975819e3, user_id=648c15c2c7d7418eb78efd52748f5572, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.482113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7dd81-b970-41a8-b264-88be1a672c78 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.499270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 923/1852] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:18 2022] PUT /identity/v3/projects/671097d8f7ce4337be3ab06e975819e3/users/648c15c2c7d7418eb78efd52748f5572/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:18.510441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32dc0a-842d-41c0-abdc-e094bef44b72 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.510915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32dc0a-842d-41c0-abdc-e094bef44b72 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.511273 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32dc0a-842d-41c0-abdc-e094bef44b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.539850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7dd81-b970-41a8-b264-88be1a672c78 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.552314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ca32dc0a-842d-41c0-abdc-e094bef44b72 None None] MFA Rules not processed for user `648c15c2c7d7418eb78efd52748f5572`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:18.553644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ca32dc0a-842d-41c0-abdc-e094bef44b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:18.624406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7dd81-b970-41a8-b264-88be1a672c78 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.629367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.630011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.630296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.630574 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.634146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:18.646777 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 930/1853] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:18.652576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32dc0a-842d-41c0-abdc-e094bef44b72 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.716231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.717851 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.729603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32dc0a-842d-41c0-abdc-e094bef44b72 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:18.730439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 924/1854] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:18.741146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ddd8-2a59-4ee3-92cb-875b951278db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:18.742037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ddd8-2a59-4ee3-92cb-875b951278db admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:18.743245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ddd8-2a59-4ee3-92cb-875b951278db admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:18.744000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4ddd8-2a59-4ee3-92cb-875b951278db admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:18.744704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4ddd8-2a59-4ee3-92cb-875b951278db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:18.746668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4ddd8-2a59-4ee3-92cb-875b951278db admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:18.814794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 931/1855] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:18 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:18.819269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:18.828926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:18.839815 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c6978-e8f4-4e28-8aa1-55fbc85ae796 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:19.004730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b83f34-6ed8-4a59-9a4e-0298f343fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:19.006885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b83f34-6ed8-4a59-9a4e-0298f343fb4a admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.007904 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b83f34-6ed8-4a59-9a4e-0298f343fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.008407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b83f34-6ed8-4a59-9a4e-0298f343fb4a admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:19.010676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b83f34-6ed8-4a59-9a4e-0298f343fb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:19.017069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b83f34-6ed8-4a59-9a4e-0298f343fb4a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:19.082026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 925/1856] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:18 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:19.083439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ddd8-2a59-4ee3-92cb-875b951278db admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:19.093478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:19.113291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4ddd8-2a59-4ee3-92cb-875b951278db admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:19.130215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ae318-8364-42ba-85d1-0290abd7a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:19.130854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae318-8364-42ba-85d1-0290abd7a7af admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.131133 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae318-8364-42ba-85d1-0290abd7a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.131653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae318-8364-42ba-85d1-0290abd7a7af admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:19.133794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ae318-8364-42ba-85d1-0290abd7a7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:19.135439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ae318-8364-42ba-85d1-0290abd7a7af admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:19.166810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 932/1857] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:19.169319 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b83f34-6ed8-4a59-9a4e-0298f343fb4a admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:19.188088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b83f34-6ed8-4a59-9a4e-0298f343fb4a admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:19.204001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e158e-3856-41bc-860e-1a4acf6d8ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:19.205251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e158e-3856-41bc-860e-1a4acf6d8ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.205549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e158e-3856-41bc-860e-1a4acf6d8ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.208082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e158e-3856-41bc-860e-1a4acf6d8ac2 admin admin] PATH_INFO: `/v3/projects/e356a1705cdb4b7aa64731d14f822bf7/users/ab840ac5d953409cb4ec319a71f3c803/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:19.251452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e158e-3856-41bc-860e-1a4acf6d8ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e356a1705cdb4b7aa64731d14f822bf7, user_id=ab840ac5d953409cb4ec319a71f3c803, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:19.260464 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e158e-3856-41bc-860e-1a4acf6d8ac2 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:19.300820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 926/1858] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:19 2022] PUT /identity/v3/projects/e356a1705cdb4b7aa64731d14f822bf7/users/ab840ac5d953409cb4ec319a71f3c803/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:19.301808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ae318-8364-42ba-85d1-0290abd7a7af admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:19.323359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ae318-8364-42ba-85d1-0290abd7a7af admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:19.332272 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e158e-3856-41bc-860e-1a4acf6d8ac2 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:19.473984 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbffdf-4138-4125-8eb5-da4e9acc3c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:19.474826 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbffdf-4138-4125-8eb5-da4e9acc3c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.480108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbffdf-4138-4125-8eb5-da4e9acc3c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.483335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbffdf-4138-4125-8eb5-da4e9acc3c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:19.484585 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbffdf-4138-4125-8eb5-da4e9acc3c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:19.489016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbffdf-4138-4125-8eb5-da4e9acc3c2c admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:19.525417 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 933/1859] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:19.528148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbffdf-4138-4125-8eb5-da4e9acc3c2c admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:19.551178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e158e-3856-41bc-860e-1a4acf6d8ac2 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:19.575952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:19.576616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.576897 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.577171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] PATH_INFO: `/v3/users/265b03f5bb6e45e198fb1f32d9ce92aa` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:19.578481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265b03f5bb6e45e198fb1f32d9ce92aa)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:19.581436 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:19.586200 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbffdf-4138-4125-8eb5-da4e9acc3c2c admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:19.591288 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6303e3-8004-44f5-becb-cd06daf4ca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:19.591996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6303e3-8004-44f5-becb-cd06daf4ca11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.592904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6303e3-8004-44f5-becb-cd06daf4ca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.592904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6303e3-8004-44f5-becb-cd06daf4ca11 admin admin] PATH_INFO: `/v3/projects/e356a1705cdb4b7aa64731d14f822bf7/users/ab840ac5d953409cb4ec319a71f3c803/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:19.599893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6303e3-8004-44f5-becb-cd06daf4ca11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e356a1705cdb4b7aa64731d14f822bf7, user_id=ab840ac5d953409cb4ec319a71f3c803, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:19.602675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6303e3-8004-44f5-becb-cd06daf4ca11 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:19.629111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 934/1860] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:19 2022] PUT /identity/v3/projects/e356a1705cdb4b7aa64731d14f822bf7/users/ab840ac5d953409cb4ec319a71f3c803/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:19.640533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb12a-06f9-4766-b481-a58d27cdceb7 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.641065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb12a-06f9-4766-b481-a58d27cdceb7 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.641526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb12a-06f9-4766-b481-a58d27cdceb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:19.683823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-28dcb12a-06f9-4766-b481-a58d27cdceb7 None None] MFA Rules not processed for user `ab840ac5d953409cb4ec319a71f3c803`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:19.685258 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-28dcb12a-06f9-4766-b481-a58d27cdceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:19.704010 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265b03f5bb6e45e198fb1f32d9ce92aa'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:19.716837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265b03f5bb6e45e198fb1f32d9ce92aa'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:19.728809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265b03f5bb6e45e198fb1f32d9ce92aa'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:19.730097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265b03f5bb6e45e198fb1f32d9ce92aa'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:19.747749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:19.759524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-76b014eb-f7e7-4b4e-9878-61525f602f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265b03f5bb6e45e198fb1f32d9ce92aa'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:19.773963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 927/1861] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:19 2022] DELETE /identity/v3/users/265b03f5bb6e45e198fb1f32d9ce92aa => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:19.778917 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62c4a3-38d8-42b4-913f-be6a4d70d415 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.779104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62c4a3-38d8-42b4-913f-be6a4d70d415 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.779311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62c4a3-38d8-42b4-913f-be6a4d70d415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:19.801249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-ab62c4a3-38d8-42b4-913f-be6a4d70d415 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:19.802647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ab62c4a3-38d8-42b4-913f-be6a4d70d415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:19.803802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 935/1862] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:19.814728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcb12a-06f9-4766-b481-a58d27cdceb7 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:19.816214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-28dcb12a-06f9-4766-b481-a58d27cdceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:19.892979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 928/1863] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:19.909606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcb12a-06f9-4766-b481-a58d27cdceb7 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:19.919698 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62c4a3-38d8-42b4-913f-be6a4d70d415 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:19.923754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:19.924180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ab62c4a3-38d8-42b4-913f-be6a4d70d415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:19.994793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:19.995741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:19.996337 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:19.996702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:20.063099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62c4a3-38d8-42b4-913f-be6a4d70d415 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:20.066997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2fa1-b5ff-4c90-afa3-5f0d786f497a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:20.067945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2fa1-b5ff-4c90-afa3-5f0d786f497a service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:20.068333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2fa1-b5ff-4c90-afa3-5f0d786f497a service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:20.068960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2fa1-b5ff-4c90-afa3-5f0d786f497a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:20.085063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2fa1-b5ff-4c90-afa3-5f0d786f497a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:20.088105 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2fa1-b5ff-4c90-afa3-5f0d786f497a service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:20.111688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 929/1864] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:20.124663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:20.126907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:20.148007 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 936/1865] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:20.250529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2fa1-b5ff-4c90-afa3-5f0d786f497a service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:20.260489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2fa1-b5ff-4c90-afa3-5f0d786f497a service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:20.264375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:20.265085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:20.265438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:20.265778 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:20.267685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:20.335601 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:20.337707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:20.348902 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 930/1866] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:20.717145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:20.718873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:20.740602 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd3d0d-b7c2-4b34-b994-2e38a3c7aaee service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:20.757398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:20.759924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:20.760272 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:20.765233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] PATH_INFO: `/v3/projects/7f60af1b029a40b388682ec171fcd7b1` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:20.768179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f60af1b029a40b388682ec171fcd7b1)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:20.772793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:20.896002 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f60af1b029a40b388682ec171fcd7b1', 'request_id': 'req-2bc8ceab-ea62-4a96-9248-574272214937'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:20.908802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f60af1b029a40b388682ec171fcd7b1', 'request_id': 'req-2bc8ceab-ea62-4a96-9248-574272214937'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:20.915859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f60af1b029a40b388682ec171fcd7b1', 'request_id': 'req-2bc8ceab-ea62-4a96-9248-574272214937'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:20.930656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] The token cache is being invalidate because project 7f60af1b029a40b388682ec171fcd7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:20.930947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:20.931565 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:20.933427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 937/1867] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:20 2022] DELETE /identity/v3/projects/7f60af1b029a40b388682ec171fcd7b1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:20.937673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:20.949361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0ca07-c7f5-4b70-935a-ab9c4cec0a7b service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:20.987644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:21.026308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:21.027036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:21.027488 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:21.027871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] PATH_INFO: `/v3/users/077bc4e872c5432789cf96a663144ea2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:21.029089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=077bc4e872c5432789cf96a663144ea2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:21.031199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:21.092697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077bc4e872c5432789cf96a663144ea2'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.101215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077bc4e872c5432789cf96a663144ea2'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.108866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077bc4e872c5432789cf96a663144ea2'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.109653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077bc4e872c5432789cf96a663144ea2'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.122976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3a838fb5-f6a6-432d-b7d7-d3fae8f5d36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077bc4e872c5432789cf96a663144ea2'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.130022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 931/1868] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:20 2022] DELETE /identity/v3/users/077bc4e872c5432789cf96a663144ea2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:21.503434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:21.505006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:21.518264 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8ceab-ea62-4a96-9248-574272214937 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:21.562573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:21.575142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:21.575791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:21.576079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:21.576352 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] PATH_INFO: `/v3/projects/daa02be3b9ef4d988cdbb83649795d1e` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:21.577455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa02be3b9ef4d988cdbb83649795d1e)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:21.579362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:21.625547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa02be3b9ef4d988cdbb83649795d1e', 'request_id': 'req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.631702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa02be3b9ef4d988cdbb83649795d1e', 'request_id': 'req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.637234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa02be3b9ef4d988cdbb83649795d1e', 'request_id': 'req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.648852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] The token cache is being invalidate because project daa02be3b9ef4d988cdbb83649795d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:21.649137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.649765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a56f6a3-68ef-40ef-bc91-e371c3cd1c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:21.651244 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 938/1869] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:21 2022] DELETE /identity/v3/projects/daa02be3b9ef4d988cdbb83649795d1e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:21.656248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218076d8-fd45-4a0a-9355-19d9fa9fef2a None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:21.656702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218076d8-fd45-4a0a-9355-19d9fa9fef2a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:21.656793 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218076d8-fd45-4a0a-9355-19d9fa9fef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:21.676304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-218076d8-fd45-4a0a-9355-19d9fa9fef2a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:21.677485 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-218076d8-fd45-4a0a-9355-19d9fa9fef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:21.737266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 932/1870] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:21.745522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61057b-9fa0-43c6-b175-f9566d515c5f None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:21.745966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61057b-9fa0-43c6-b175-f9566d515c5f None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:21.746057 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61057b-9fa0-43c6-b175-f9566d515c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:21.766550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3e61057b-9fa0-43c6-b175-f9566d515c5f None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:21.767644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3e61057b-9fa0-43c6-b175-f9566d515c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:21.779439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 939/1871] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:21.780481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218076d8-fd45-4a0a-9355-19d9fa9fef2a None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:21.790684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218076d8-fd45-4a0a-9355-19d9fa9fef2a None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:21.795261 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:21.795898 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:21.796183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:21.796452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:21.797226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:21.797534 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:21.799109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:21.819661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61057b-9fa0-43c6-b175-f9566d515c5f None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:21.824267 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 933/1872] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:21.829186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61057b-9fa0-43c6-b175-f9566d515c5f None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:21.833825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a9775-d77c-4824-92f3-6194312ecd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:21.834426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9775-d77c-4824-92f3-6194312ecd51 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:21.834703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9775-d77c-4824-92f3-6194312ecd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:21.834975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9775-d77c-4824-92f3-6194312ecd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:21.835600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a9775-d77c-4824-92f3-6194312ecd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:21.838014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a9775-d77c-4824-92f3-6194312ecd51 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:21.897880 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 940/1873] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:21 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:21.900432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:21.915152 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54444cb0-db05-4b71-9fc2-4be49f5ecfd8 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:21.954820 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:21.987335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6de60-2439-47f4-8b19-0e0466eb154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:21.988446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6de60-2439-47f4-8b19-0e0466eb154e admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:21.989121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6de60-2439-47f4-8b19-0e0466eb154e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:21.989692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6de60-2439-47f4-8b19-0e0466eb154e admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:21.991299 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6de60-2439-47f4-8b19-0e0466eb154e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:21.993588 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6de60-2439-47f4-8b19-0e0466eb154e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.046848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 934/1874] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:21 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:22.050722 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a9775-d77c-4824-92f3-6194312ecd51 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.072155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a9775-d77c-4824-92f3-6194312ecd51 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.085517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5c165-6d95-4571-bfa3-5ef4bd466e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.086874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c165-6d95-4571-bfa3-5ef4bd466e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.087379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c165-6d95-4571-bfa3-5ef4bd466e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.087702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c165-6d95-4571-bfa3-5ef4bd466e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.088450 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5c165-6d95-4571-bfa3-5ef4bd466e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.090194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5c165-6d95-4571-bfa3-5ef4bd466e5a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.109769 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 941/1875] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:22.115226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6de60-2439-47f4-8b19-0e0466eb154e admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.132552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6de60-2439-47f4-8b19-0e0466eb154e admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.138672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df85b8e-3cb2-492e-b99d-7a8aaa64021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.139282 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85b8e-3cb2-492e-b99d-7a8aaa64021a admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.139564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85b8e-3cb2-492e-b99d-7a8aaa64021a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.139886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85b8e-3cb2-492e-b99d-7a8aaa64021a admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.140528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df85b8e-3cb2-492e-b99d-7a8aaa64021a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.142314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df85b8e-3cb2-492e-b99d-7a8aaa64021a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.154521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 935/1876] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:22.158981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5c165-6d95-4571-bfa3-5ef4bd466e5a admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.169759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5c165-6d95-4571-bfa3-5ef4bd466e5a admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.174664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.175332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.175612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.175921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] PATH_INFO: `/v3/projects/844753013c42481582c25bb8648c93db/users/4ea79427c8e64609b4df81f59832e01b/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.192914 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844753013c42481582c25bb8648c93db, user_id=4ea79427c8e64609b4df81f59832e01b, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.196222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.214732 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 942/1877] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:22 2022] PUT /identity/v3/projects/844753013c42481582c25bb8648c93db/users/4ea79427c8e64609b4df81f59832e01b/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:22.227955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3060-2cba-4df3-8caf-9ad2e4720ae8 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.228275 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3060-2cba-4df3-8caf-9ad2e4720ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.228512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3060-2cba-4df3-8caf-9ad2e4720ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.256721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c3ca3060-2cba-4df3-8caf-9ad2e4720ae8 None None] MFA Rules not processed for user `4ea79427c8e64609b4df81f59832e01b`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:22.258483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c3ca3060-2cba-4df3-8caf-9ad2e4720ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:22.323826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 936/1878] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:22.335061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.337374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:22.392894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9056d52-bc70-442c-aaa1-1b7a01c09906 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.396554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66f077-2905-4c36-80e8-59d4eb838903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.397156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66f077-2905-4c36-80e8-59d4eb838903 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.397432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66f077-2905-4c36-80e8-59d4eb838903 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.397704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66f077-2905-4c36-80e8-59d4eb838903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.406461 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66f077-2905-4c36-80e8-59d4eb838903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.407928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66f077-2905-4c36-80e8-59d4eb838903 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.416455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 943/1879] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:22.437642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca3060-2cba-4df3-8caf-9ad2e4720ae8 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.502403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca3060-2cba-4df3-8caf-9ad2e4720ae8 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.508164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.509091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.509091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.509350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] PATH_INFO: `/v3/users/4ea79427c8e64609b4df81f59832e01b` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.510468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea79427c8e64609b4df81f59832e01b)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.512424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.561184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea79427c8e64609b4df81f59832e01b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:22.562529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:22.576322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea79427c8e64609b4df81f59832e01b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:22.585449 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea79427c8e64609b4df81f59832e01b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:22.586123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea79427c8e64609b4df81f59832e01b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:22.598244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea79427c8e64609b4df81f59832e01b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:22.604591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 937/1880] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:22 2022] DELETE /identity/v3/users/4ea79427c8e64609b4df81f59832e01b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:22.609087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736e2b-308f-4848-bf27-ef14368b29fb None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.609377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736e2b-308f-4848-bf27-ef14368b29fb None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.609654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736e2b-308f-4848-bf27-ef14368b29fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.629102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-10736e2b-308f-4848-bf27-ef14368b29fb None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:22.630243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-10736e2b-308f-4848-bf27-ef14368b29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:22.642824 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:22.690111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 944/1881] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:22.700333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:22.701721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:22.758115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afda79-2ffc-4dcd-ad95-28ceed5a0a26 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:22.761880 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce976be-d091-448b-93d4-82ba9e563568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:22.762500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce976be-d091-448b-93d4-82ba9e563568 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:22.762778 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce976be-d091-448b-93d4-82ba9e563568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:22.763049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce976be-d091-448b-93d4-82ba9e563568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:22.772024 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce976be-d091-448b-93d4-82ba9e563568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:22.773930 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce976be-d091-448b-93d4-82ba9e563568 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:22.783165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 938/1882] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:23.042562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10736e2b-308f-4848-bf27-ef14368b29fb None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.045020 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-10736e2b-308f-4848-bf27-ef14368b29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.059315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10736e2b-308f-4848-bf27-ef14368b29fb None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.067249 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.068696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.069154 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.069572 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] PATH_INFO: `/v3/projects/844753013c42481582c25bb8648c93db` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.072097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=844753013c42481582c25bb8648c93db)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.075640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.137340 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844753013c42481582c25bb8648c93db', 'request_id': 'req-ca16def4-ebea-4e66-8a72-53ea3d727cfa'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:23.144615 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844753013c42481582c25bb8648c93db', 'request_id': 'req-ca16def4-ebea-4e66-8a72-53ea3d727cfa'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:23.155283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844753013c42481582c25bb8648c93db', 'request_id': 'req-ca16def4-ebea-4e66-8a72-53ea3d727cfa'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:23.176586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] The token cache is being invalidate because project 844753013c42481582c25bb8648c93db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:23.177116 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:23.178113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ca16def4-ebea-4e66-8a72-53ea3d727cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:23.180076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 945/1883] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:23 2022] DELETE /identity/v3/projects/844753013c42481582c25bb8648c93db => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:23.184999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5a76-58f0-4f40-9109-e0b8b9650fea None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.185296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5a76-58f0-4f40-9109-e0b8b9650fea None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.185575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea5a76-58f0-4f40-9109-e0b8b9650fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.210398 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7bea5a76-58f0-4f40-9109-e0b8b9650fea None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.212852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7bea5a76-58f0-4f40-9109-e0b8b9650fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.407408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 939/1884] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:23.408642 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e594d-28fc-41c1-b4dc-d5e39e814b38 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.408990 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e594d-28fc-41c1-b4dc-d5e39e814b38 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.409810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e594d-28fc-41c1-b4dc-d5e39e814b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.442305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6f5e594d-28fc-41c1-b4dc-d5e39e814b38 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.450465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6f5e594d-28fc-41c1-b4dc-d5e39e814b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:23.466626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 946/1885] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:23.467960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea5a76-58f0-4f40-9109-e0b8b9650fea None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.485710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea5a76-58f0-4f40-9109-e0b8b9650fea None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.503305 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.504531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.506135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.506682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.508682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:23.509190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.513421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.538036 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 940/1886] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:23.541346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e594d-28fc-41c1-b4dc-d5e39e814b38 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.557461 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e594d-28fc-41c1-b4dc-d5e39e814b38 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.569626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264fecb-187a-4678-9dd3-f8596a9f37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.570967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264fecb-187a-4678-9dd3-f8596a9f37f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.571814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264fecb-187a-4678-9dd3-f8596a9f37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.572174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264fecb-187a-4678-9dd3-f8596a9f37f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.572983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264fecb-187a-4678-9dd3-f8596a9f37f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.575204 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264fecb-187a-4678-9dd3-f8596a9f37f3 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.632362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 947/1887] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:23.637523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.651290 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee29df-626b-4ed5-b140-d7fe8652f5ee admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.722740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:23.737646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037cc1-947d-467c-b097-1661c360fb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.738852 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037cc1-947d-467c-b097-1661c360fb6c admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.739541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037cc1-947d-467c-b097-1661c360fb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.740001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037cc1-947d-467c-b097-1661c360fb6c admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.740524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037cc1-947d-467c-b097-1661c360fb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.743498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037cc1-947d-467c-b097-1661c360fb6c admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.773740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 941/1888] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:23.778069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264fecb-187a-4678-9dd3-f8596a9f37f3 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.788724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264fecb-187a-4678-9dd3-f8596a9f37f3 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.796283 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cb022-0522-494b-a9ad-26cc79641966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.797009 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb022-0522-494b-a9ad-26cc79641966 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.797401 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb022-0522-494b-a9ad-26cc79641966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.797748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb022-0522-494b-a9ad-26cc79641966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.798494 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cb022-0522-494b-a9ad-26cc79641966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.800502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cb022-0522-494b-a9ad-26cc79641966 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.828066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 948/1889] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:23.836648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037cc1-947d-467c-b097-1661c360fb6c admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.849157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037cc1-947d-467c-b097-1661c360fb6c admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.854090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa61b54-5cf4-4ccc-9fe9-3f3aab401b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.854715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa61b54-5cf4-4ccc-9fe9-3f3aab401b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.855000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa61b54-5cf4-4ccc-9fe9-3f3aab401b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.855423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa61b54-5cf4-4ccc-9fe9-3f3aab401b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.856106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa61b54-5cf4-4ccc-9fe9-3f3aab401b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.857709 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa61b54-5cf4-4ccc-9fe9-3f3aab401b24 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.869705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 942/1890] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:23.873927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cb022-0522-494b-a9ad-26cc79641966 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:23.886655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cb022-0522-494b-a9ad-26cc79641966 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:23.891842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d157a1d-c519-4d75-8f89-091da04f0c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:23.892551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157a1d-c519-4d75-8f89-091da04f0c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.892835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157a1d-c519-4d75-8f89-091da04f0c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.893111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157a1d-c519-4d75-8f89-091da04f0c50 admin admin] PATH_INFO: `/v3/projects/fca69e2d75dc4f53baa4fd0c4684cb0b/users/b4333e7a467448f2965202ebeef1cd4f/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.908879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d157a1d-c519-4d75-8f89-091da04f0c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca69e2d75dc4f53baa4fd0c4684cb0b, user_id=b4333e7a467448f2965202ebeef1cd4f, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:23.911561 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d157a1d-c519-4d75-8f89-091da04f0c50 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:23.924177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 949/1891] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:23 2022] PUT /identity/v3/projects/fca69e2d75dc4f53baa4fd0c4684cb0b/users/b4333e7a467448f2965202ebeef1cd4f/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:23.935128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895de99-afec-4807-9429-7cb520c00711 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:23.935420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895de99-afec-4807-9429-7cb520c00711 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:23.935703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895de99-afec-4807-9429-7cb520c00711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:23.965549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-4895de99-afec-4807-9429-7cb520c00711 None None] MFA Rules not processed for user `b4333e7a467448f2965202ebeef1cd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:23.966708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4895de99-afec-4807-9429-7cb520c00711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:24.030204 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 943/1892] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:24.034845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d157a1d-c519-4d75-8f89-091da04f0c50 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.076350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:24.097635 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d157a1d-c519-4d75-8f89-091da04f0c50 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.102285 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a6ae9-7946-4295-89f9-3050533e0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.102890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a6ae9-7946-4295-89f9-3050533e0d15 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.103175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a6ae9-7946-4295-89f9-3050533e0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.103458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a6ae9-7946-4295-89f9-3050533e0d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.104142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a6ae9-7946-4295-89f9-3050533e0d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.106058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a6ae9-7946-4295-89f9-3050533e0d15 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.133978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 950/1893] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.138145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895de99-afec-4807-9429-7cb520c00711 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.148724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895de99-afec-4807-9429-7cb520c00711 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.206784 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5000-edbf-47ba-a1ed-443fb3950d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.207459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5000-edbf-47ba-a1ed-443fb3950d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.207743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5000-edbf-47ba-a1ed-443fb3950d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.208091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5000-edbf-47ba-a1ed-443fb3950d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.208744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a5000-edbf-47ba-a1ed-443fb3950d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.210668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a5000-edbf-47ba-a1ed-443fb3950d7d admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.230931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 944/1894] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.234697 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a6ae9-7946-4295-89f9-3050533e0d15 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.245222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a6ae9-7946-4295-89f9-3050533e0d15 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.249676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c7bfe-5bc0-48fc-8abf-c77a84084cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.250271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c7bfe-5bc0-48fc-8abf-c77a84084cda admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.250547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c7bfe-5bc0-48fc-8abf-c77a84084cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.250815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c7bfe-5bc0-48fc-8abf-c77a84084cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.251447 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c7bfe-5bc0-48fc-8abf-c77a84084cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.253066 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c7bfe-5bc0-48fc-8abf-c77a84084cda admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.267123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 951/1895] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:24.268497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5000-edbf-47ba-a1ed-443fb3950d7d admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.278877 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5000-edbf-47ba-a1ed-443fb3950d7d admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.283497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad4807-3dce-44f4-b995-441cb6fa2bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.284171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4807-3dce-44f4-b995-441cb6fa2bac admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.284459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4807-3dce-44f4-b995-441cb6fa2bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.284729 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad4807-3dce-44f4-b995-441cb6fa2bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.285369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad4807-3dce-44f4-b995-441cb6fa2bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.286951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad4807-3dce-44f4-b995-441cb6fa2bac admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.297014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 945/1896] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:24.301305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c7bfe-5bc0-48fc-8abf-c77a84084cda admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.311833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c7bfe-5bc0-48fc-8abf-c77a84084cda admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.316503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d382b-3637-49bf-b4bc-ee239ca952d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.317314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d382b-3637-49bf-b4bc-ee239ca952d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.317497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d382b-3637-49bf-b4bc-ee239ca952d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.317760 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d382b-3637-49bf-b4bc-ee239ca952d2 admin admin] PATH_INFO: `/v3/projects/2b7b31b3b8204a6bbf69ae623b8f21a0/users/b1616b85c4aa4a8896d192a45719fd29/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.333535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d382b-3637-49bf-b4bc-ee239ca952d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7b31b3b8204a6bbf69ae623b8f21a0, user_id=b1616b85c4aa4a8896d192a45719fd29, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.336285 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d382b-3637-49bf-b4bc-ee239ca952d2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.349497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 952/1897] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:24 2022] PUT /identity/v3/projects/2b7b31b3b8204a6bbf69ae623b8f21a0/users/b1616b85c4aa4a8896d192a45719fd29/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:24.361377 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761fdcb-30f8-411f-a186-b699e218ccd9 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.361668 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761fdcb-30f8-411f-a186-b699e218ccd9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.361943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761fdcb-30f8-411f-a186-b699e218ccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.401800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-1761fdcb-30f8-411f-a186-b699e218ccd9 None None] MFA Rules not processed for user `b1616b85c4aa4a8896d192a45719fd29`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:24.403745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1761fdcb-30f8-411f-a186-b699e218ccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:24.446837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:24.484186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 946/1898] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:24.488467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d382b-3637-49bf-b4bc-ee239ca952d2 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.558211 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d382b-3637-49bf-b4bc-ee239ca952d2 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.563157 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117d545-2d85-4d56-834d-24dd834d938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.563922 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117d545-2d85-4d56-834d-24dd834d938b admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.564271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117d545-2d85-4d56-834d-24dd834d938b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.564612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117d545-2d85-4d56-834d-24dd834d938b admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.565310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117d545-2d85-4d56-834d-24dd834d938b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.567227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117d545-2d85-4d56-834d-24dd834d938b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.593956 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 953/1899] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.599162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761fdcb-30f8-411f-a186-b699e218ccd9 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.613172 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761fdcb-30f8-411f-a186-b699e218ccd9 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.676598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36451-cebd-4213-b505-6a16f42dcce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.678009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36451-cebd-4213-b505-6a16f42dcce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.681427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36451-cebd-4213-b505-6a16f42dcce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.681915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36451-cebd-4213-b505-6a16f42dcce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.682892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a36451-cebd-4213-b505-6a16f42dcce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.685603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a36451-cebd-4213-b505-6a16f42dcce9 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.714352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 947/1900] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:24.719652 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117d545-2d85-4d56-834d-24dd834d938b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.732765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117d545-2d85-4d56-834d-24dd834d938b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.738156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76849dd8-cbfb-47aa-ac51-6eddc0665432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.738802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849dd8-cbfb-47aa-ac51-6eddc0665432 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.739097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849dd8-cbfb-47aa-ac51-6eddc0665432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.739400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76849dd8-cbfb-47aa-ac51-6eddc0665432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.740106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76849dd8-cbfb-47aa-ac51-6eddc0665432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.741814 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76849dd8-cbfb-47aa-ac51-6eddc0665432 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.753510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 954/1901] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:24.758585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36451-cebd-4213-b505-6a16f42dcce9 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.769361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36451-cebd-4213-b505-6a16f42dcce9 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.775257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a3458-5678-4af1-8dbf-eba9bb37f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.776006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3458-5678-4af1-8dbf-eba9bb37f973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.776259 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3458-5678-4af1-8dbf-eba9bb37f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.776566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3458-5678-4af1-8dbf-eba9bb37f973 admin admin] PATH_INFO: `/v3/projects/b3175ac9c49c41598a4d6cccb94d95d4/users/f67d0006c63d4e8b8ba667b4cdb8c753/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.792270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a3458-5678-4af1-8dbf-eba9bb37f973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3175ac9c49c41598a4d6cccb94d95d4, user_id=f67d0006c63d4e8b8ba667b4cdb8c753, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.794935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a3458-5678-4af1-8dbf-eba9bb37f973 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.809922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 948/1902] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:24 2022] PUT /identity/v3/projects/b3175ac9c49c41598a4d6cccb94d95d4/users/f67d0006c63d4e8b8ba667b4cdb8c753/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:24.812266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76849dd8-cbfb-47aa-ac51-6eddc0665432 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.825419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76849dd8-cbfb-47aa-ac51-6eddc0665432 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.894583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc246a-1530-4d20-9eac-b34488db95e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.895206 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc246a-1530-4d20-9eac-b34488db95e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.897360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc246a-1530-4d20-9eac-b34488db95e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.897360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc246a-1530-4d20-9eac-b34488db95e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.897360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc246a-1530-4d20-9eac-b34488db95e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.898890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc246a-1530-4d20-9eac-b34488db95e1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.902231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:24.918160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 955/1903] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:24.919626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a3458-5678-4af1-8dbf-eba9bb37f973 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:24.934691 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a3458-5678-4af1-8dbf-eba9bb37f973 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:24.946867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:24.947817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.948358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.948490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] PATH_INFO: `/v3/projects/b3175ac9c49c41598a4d6cccb94d95d4/users/f67d0006c63d4e8b8ba667b4cdb8c753/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:24.950937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3175ac9c49c41598a4d6cccb94d95d4, user_id=f67d0006c63d4e8b8ba667b4cdb8c753, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:24.953565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:24.967062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 949/1904] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:24 2022] PUT /identity/v3/projects/b3175ac9c49c41598a4d6cccb94d95d4/users/f67d0006c63d4e8b8ba667b4cdb8c753/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:24.978702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4453-2dc0-44e8-892f-6ea065ea8964 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:24.979018 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4453-2dc0-44e8-892f-6ea065ea8964 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:24.979296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b4453-2dc0-44e8-892f-6ea065ea8964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.019686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f84b4453-2dc0-44e8-892f-6ea065ea8964 None None] MFA Rules not processed for user `f67d0006c63d4e8b8ba667b4cdb8c753`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:25.020987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f84b4453-2dc0-44e8-892f-6ea065ea8964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:25.093636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 956/1905] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:25.105034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.107545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:25.166914 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed6e7-2660-406d-b96e-8e6d05a61b73 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.170563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bd346-ea80-4b4d-8769-29cc25554461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.171173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd346-ea80-4b4d-8769-29cc25554461 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.171462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd346-ea80-4b4d-8769-29cc25554461 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.171737 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd346-ea80-4b4d-8769-29cc25554461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.210468 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:25.230575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bd346-ea80-4b4d-8769-29cc25554461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.232041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bd346-ea80-4b4d-8769-29cc25554461 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.240998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 950/1906] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:25.477698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b4453-2dc0-44e8-892f-6ea065ea8964 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:25.479408 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f84b4453-2dc0-44e8-892f-6ea065ea8964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:25.604405 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b4453-2dc0-44e8-892f-6ea065ea8964 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:25.621644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:25.623082 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.623521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.624631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] PATH_INFO: `/v3/users/648c15c2c7d7418eb78efd52748f5572` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.626030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] RBAC: Authorizing `identity:delete_user(user_id=648c15c2c7d7418eb78efd52748f5572)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:25.628745 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:25.705938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648c15c2c7d7418eb78efd52748f5572'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:25.706802 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648c15c2c7d7418eb78efd52748f5572'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:25.716724 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648c15c2c7d7418eb78efd52748f5572'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:25.717487 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648c15c2c7d7418eb78efd52748f5572'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:25.726203 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648c15c2c7d7418eb78efd52748f5572'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:25.751276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 957/1907] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:25 2022] DELETE /identity/v3/users/648c15c2c7d7418eb78efd52748f5572 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:25.755758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbfde2-ad43-4a73-b1a8-39f1e0986697 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:25.756069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbfde2-ad43-4a73-b1a8-39f1e0986697 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:25.756590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbfde2-ad43-4a73-b1a8-39f1e0986697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:25.778519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-6cfbfde2-ad43-4a73-b1a8-39f1e0986697 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:25.779096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6cfbfde2-ad43-4a73-b1a8-39f1e0986697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:25.870855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 951/1908] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:26.133410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.135404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:26.142327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:26.223163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab27d-6d8c-4467-9ef5-33d83437892f admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.229421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6aeba-0a52-4e40-904a-d458ced1eab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.230361 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6aeba-0a52-4e40-904a-d458ced1eab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.230945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6aeba-0a52-4e40-904a-d458ced1eab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.231425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6aeba-0a52-4e40-904a-d458ced1eab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.244455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6aeba-0a52-4e40-904a-d458ced1eab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.246999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6aeba-0a52-4e40-904a-d458ced1eab9 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.259178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 958/1909] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:26.417000 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbfde2-ad43-4a73-b1a8-39f1e0986697 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.419046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6cfbfde2-ad43-4a73-b1a8-39f1e0986697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:26.437187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbfde2-ad43-4a73-b1a8-39f1e0986697 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:26.465921 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:26.466590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.466883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.467701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] PATH_INFO: `/v3/users/1b86cd0eb2b64abc8b2484ec160bb7e6` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.476015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b86cd0eb2b64abc8b2484ec160bb7e6)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:26.482442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:26.582817 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b86cd0eb2b64abc8b2484ec160bb7e6'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:26.596212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b86cd0eb2b64abc8b2484ec160bb7e6'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:26.614888 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b86cd0eb2b64abc8b2484ec160bb7e6'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:26.615547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b86cd0eb2b64abc8b2484ec160bb7e6'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:26.641567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b86cd0eb2b64abc8b2484ec160bb7e6'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:26.665060 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 952/1910] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:26 2022] DELETE /identity/v3/users/1b86cd0eb2b64abc8b2484ec160bb7e6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:26.667294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361644c-147c-4f6c-b641-2abe82ffc5f9 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:26.667687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361644c-147c-4f6c-b641-2abe82ffc5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:26.668259 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361644c-147c-4f6c-b641-2abe82ffc5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:26.728099 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-9361644c-147c-4f6c-b641-2abe82ffc5f9 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:26.731964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9361644c-147c-4f6c-b641-2abe82ffc5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:26.957755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 959/1911] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:26.981561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:26.983263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.142370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361644c-147c-4f6c-b641-2abe82ffc5f9 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.144979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9361644c-147c-4f6c-b641-2abe82ffc5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.185644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f017d3-b570-45bd-8215-86906c451307 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.197329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23e0c4-abc0-4318-93e9-95e982239a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.197998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23e0c4-abc0-4318-93e9-95e982239a7e service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.198301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23e0c4-abc0-4318-93e9-95e982239a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.198557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23e0c4-abc0-4318-93e9-95e982239a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.210269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:27.221826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23e0c4-abc0-4318-93e9-95e982239a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.223299 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23e0c4-abc0-4318-93e9-95e982239a7e service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.244709 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 953/1912] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:27.245751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653e25-2281-4603-963f-b31ebf9fc233 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.246064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653e25-2281-4603-963f-b31ebf9fc233 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.247685 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653e25-2281-4603-963f-b31ebf9fc233 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.249928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 954/1913] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:43:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:43:27.260488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361644c-147c-4f6c-b641-2abe82ffc5f9 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.264978 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0c08-b457-4d31-b6d5-f64951256945 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.265410 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0c08-b457-4d31-b6d5-f64951256945 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.265620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0c08-b457-4d31-b6d5-f64951256945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.272407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.273215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.276149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.276433 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.290551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-da2c0c08-b457-4d31-b6d5-f64951256945 None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:27.292130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-da2c0c08-b457-4d31-b6d5-f64951256945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.292638 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.398655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.400833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.406727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:27.415583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 960/1914] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:27.416731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.418111 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.442441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0d39c-38a3-43f5-8fb9-802e4ea64453 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.443418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 955/1915] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:27.457951 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0c08-b457-4d31-b6d5-f64951256945 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.460114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-da2c0c08-b457-4d31-b6d5-f64951256945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.464251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.466303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.467058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.467308 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] PATH_INFO: `/v3/projects/671097d8f7ce4337be3ab06e975819e3` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.473023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671097d8f7ce4337be3ab06e975819e3)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.475123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.488655 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0c08-b457-4d31-b6d5-f64951256945 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.502280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80eaff8-45e6-4bbd-ad35-94883e3c710b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.503068 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80eaff8-45e6-4bbd-ad35-94883e3c710b service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.503519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80eaff8-45e6-4bbd-ad35-94883e3c710b service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.503947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80eaff8-45e6-4bbd-ad35-94883e3c710b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.529254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80eaff8-45e6-4bbd-ad35-94883e3c710b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.531021 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80eaff8-45e6-4bbd-ad35-94883e3c710b service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.565019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 956/1916] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:27.604451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671097d8f7ce4337be3ab06e975819e3', 'request_id': 'req-f0332019-730b-492d-a08b-221050edf065'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.620047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671097d8f7ce4337be3ab06e975819e3', 'request_id': 'req-f0332019-730b-492d-a08b-221050edf065'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.627002 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671097d8f7ce4337be3ab06e975819e3', 'request_id': 'req-f0332019-730b-492d-a08b-221050edf065'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.645979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] The token cache is being invalidate because project 671097d8f7ce4337be3ab06e975819e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:27.646359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.647874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.650728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 961/1917] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:27 2022] DELETE /identity/v3/projects/671097d8f7ce4337be3ab06e975819e3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:27.655265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80eaff8-45e6-4bbd-ad35-94883e3c710b service nova] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.674224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80eaff8-45e6-4bbd-ad35-94883e3c710b service nova] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.748720 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.751088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:27.797102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.797996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.798284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.798563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] PATH_INFO: `/v3/users/ab840ac5d953409cb4ec319a71f3c803` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.800524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab840ac5d953409cb4ec319a71f3c803)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.802542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.864385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab840ac5d953409cb4ec319a71f3c803'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.875582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0332019-730b-492d-a08b-221050edf065 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:27.876126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab840ac5d953409cb4ec319a71f3c803'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.885675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:27.886919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:27.887287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:27.887670 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] PATH_INFO: `/v3/projects/9a63be68ef9b49dca0cfa35e7eed46dc` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:27.888044 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab840ac5d953409cb4ec319a71f3c803'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.888816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab840ac5d953409cb4ec319a71f3c803'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.889265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a63be68ef9b49dca0cfa35e7eed46dc)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:27.893042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:27.905233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:27.911089 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab840ac5d953409cb4ec319a71f3c803'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.920033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 957/1918] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:27 2022] DELETE /identity/v3/users/ab840ac5d953409cb4ec319a71f3c803 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:27.956650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a63be68ef9b49dca0cfa35e7eed46dc', 'request_id': 'req-631bf263-5802-4982-98d5-fccdda195e74'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.963714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a63be68ef9b49dca0cfa35e7eed46dc', 'request_id': 'req-631bf263-5802-4982-98d5-fccdda195e74'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.969495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a63be68ef9b49dca0cfa35e7eed46dc', 'request_id': 'req-631bf263-5802-4982-98d5-fccdda195e74'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.983382 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] The token cache is being invalidate because project 9a63be68ef9b49dca0cfa35e7eed46dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:27.983926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.984661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:27.986183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 962/1919] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:27 2022] DELETE /identity/v3/projects/9a63be68ef9b49dca0cfa35e7eed46dc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:27.990506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:27.992022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.062239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7e224-dd5d-4c5d-a671-a399122e5984 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.122006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.122790 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.123074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.123359 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] PATH_INFO: `/v3/users/7c8052c18bd8478db28980bbcc058485` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.124599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8052c18bd8478db28980bbcc058485)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.126543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.198809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8052c18bd8478db28980bbcc058485'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.205748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8052c18bd8478db28980bbcc058485'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.214343 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8052c18bd8478db28980bbcc058485'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.215059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8052c18bd8478db28980bbcc058485'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.228632 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-d4146fb9-f598-4787-b1e6-07314798cd5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8052c18bd8478db28980bbcc058485'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.235621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 958/1920] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:27 2022] DELETE /identity/v3/users/7c8052c18bd8478db28980bbcc058485 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:28.292255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.293833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.308210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf263-5802-4982-98d5-fccdda195e74 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.320976 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:28.378317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.380530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.380832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.381117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] PATH_INFO: `/v3/projects/e356a1705cdb4b7aa64731d14f822bf7` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.383125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e356a1705cdb4b7aa64731d14f822bf7)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.385362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.440364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e356a1705cdb4b7aa64731d14f822bf7', 'request_id': 'req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.447300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e356a1705cdb4b7aa64731d14f822bf7', 'request_id': 'req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.454567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e356a1705cdb4b7aa64731d14f822bf7', 'request_id': 'req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.467918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] The token cache is being invalidate because project e356a1705cdb4b7aa64731d14f822bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:28.468245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.468930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d43b7084-71f0-4cf3-9652-9d3cbe3e6fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.470499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 963/1921] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:28 2022] DELETE /identity/v3/projects/e356a1705cdb4b7aa64731d14f822bf7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:28.475513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774d29-aedf-474b-aadf-c4cd61218e26 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.475835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774d29-aedf-474b-aadf-c4cd61218e26 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.476174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f774d29-aedf-474b-aadf-c4cd61218e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.497670 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7f774d29-aedf-474b-aadf-c4cd61218e26 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:28.498887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7f774d29-aedf-474b-aadf-c4cd61218e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.512364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:28.563647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 959/1922] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:28.573157 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24222cc-0993-4d30-98bc-a6b8125c0802 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.573403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24222cc-0993-4d30-98bc-a6b8125c0802 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.573662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24222cc-0993-4d30-98bc-a6b8125c0802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.594488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-f24222cc-0993-4d30-98bc-a6b8125c0802 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:28.595761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f24222cc-0993-4d30-98bc-a6b8125c0802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.604360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 964/1923] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:28.609023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f774d29-aedf-474b-aadf-c4cd61218e26 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.617237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24222cc-0993-4d30-98bc-a6b8125c0802 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.619556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f24222cc-0993-4d30-98bc-a6b8125c0802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.620075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f774d29-aedf-474b-aadf-c4cd61218e26 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.625003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.625617 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.625894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.626166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.626811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:28.627112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.628826 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.637785 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24222cc-0993-4d30-98bc-a6b8125c0802 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.642474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 960/1924] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:28.643639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.644327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.644609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.644889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] PATH_INFO: `/v3/projects/21ab96ce95ae491f933b70a502ef4477` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.646187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21ab96ce95ae491f933b70a502ef4477)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.647257 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.648365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.663976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba461023-41ce-451b-8f3f-71e79a3ddb5f admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.669696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde31ed-cf43-4333-96f2-6c351663734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.670303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde31ed-cf43-4333-96f2-6c351663734d admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.670584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde31ed-cf43-4333-96f2-6c351663734d admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.670856 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde31ed-cf43-4333-96f2-6c351663734d admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.671516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde31ed-cf43-4333-96f2-6c351663734d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.673433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde31ed-cf43-4333-96f2-6c351663734d admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.698729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21ab96ce95ae491f933b70a502ef4477', 'request_id': 'req-6a599197-61cf-4c51-9219-2007987a673e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.702756 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 961/1925] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:28.706771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde31ed-cf43-4333-96f2-6c351663734d admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.706979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21ab96ce95ae491f933b70a502ef4477', 'request_id': 'req-6a599197-61cf-4c51-9219-2007987a673e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.713234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21ab96ce95ae491f933b70a502ef4477', 'request_id': 'req-6a599197-61cf-4c51-9219-2007987a673e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.727275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] The token cache is being invalidate because project 21ab96ce95ae491f933b70a502ef4477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:28.727695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.728379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a599197-61cf-4c51-9219-2007987a673e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:28.730507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 965/1926] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:28 2022] DELETE /identity/v3/projects/21ab96ce95ae491f933b70a502ef4477 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:28.735546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8f6e-35e1-44b4-9f81-6e8268dfa905 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.735675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8f6e-35e1-44b4-9f81-6e8268dfa905 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.735958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8f6e-35e1-44b4-9f81-6e8268dfa905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.759375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4bce8f6e-35e1-44b4-9f81-6e8268dfa905 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:28.761160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4bce8f6e-35e1-44b4-9f81-6e8268dfa905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.778110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:28.780430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde31ed-cf43-4333-96f2-6c351663734d admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.786123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.787026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.787307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.787579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.788248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.790727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.816214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 962/1927] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:28.821181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.823535 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.833396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 966/1928] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:28.839005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3634ec-5121-4ae7-9363-99fcdf22f13b admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.841458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b761-f60c-465e-9ad3-410a0facfa63 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.841746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b761-f60c-465e-9ad3-410a0facfa63 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.842019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247b761-f60c-465e-9ad3-410a0facfa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.844208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d80bb-6851-4eff-ae0d-fdc8ccbb9f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.844832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d80bb-6851-4eff-ae0d-fdc8ccbb9f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.845828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d80bb-6851-4eff-ae0d-fdc8ccbb9f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.846101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d80bb-6851-4eff-ae0d-fdc8ccbb9f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.846757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d80bb-6851-4eff-ae0d-fdc8ccbb9f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.848383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d80bb-6851-4eff-ae0d-fdc8ccbb9f7f admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.858971 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 963/1929] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:28.862735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-1247b761-f60c-465e-9ad3-410a0facfa63 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:28.863809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d80bb-6851-4eff-ae0d-fdc8ccbb9f7f admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.864128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1247b761-f60c-465e-9ad3-410a0facfa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:28.873441 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 967/1930] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:28.878144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d80bb-6851-4eff-ae0d-fdc8ccbb9f7f admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.879640 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b761-f60c-465e-9ad3-410a0facfa63 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.884156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f647f89-7500-47bf-b3b8-8965977b64db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.884741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647f89-7500-47bf-b3b8-8965977b64db admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.885028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647f89-7500-47bf-b3b8-8965977b64db admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.885304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f647f89-7500-47bf-b3b8-8965977b64db admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.885946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f647f89-7500-47bf-b3b8-8965977b64db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.887633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f647f89-7500-47bf-b3b8-8965977b64db admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.897044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247b761-f60c-465e-9ad3-410a0facfa63 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.897044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.897044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.897044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.897342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.897342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:28.897342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.897846 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.907452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 964/1931] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:28.911462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f647f89-7500-47bf-b3b8-8965977b64db admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.916603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 968/1932] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:28.917547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.921653 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f647f89-7500-47bf-b3b8-8965977b64db admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.926290 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607d525-2387-4ac3-9c9a-fbc3cbee6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.926933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d525-2387-4ac3-9c9a-fbc3cbee6fac admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.927212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d525-2387-4ac3-9c9a-fbc3cbee6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.927303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd99625-8cd2-4279-9a18-551480d94898 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:28.927484 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d525-2387-4ac3-9c9a-fbc3cbee6fac admin admin] PATH_INFO: `/v3/projects/72a4aef1c873442fa06739f68f433567/users/8561d503d7f04bc2870e1c21fe9b0183/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.932626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016d80d-8f36-41df-a4f5-e37fcb0c4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:28.933211 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016d80d-8f36-41df-a4f5-e37fcb0c4006 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.933490 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016d80d-8f36-41df-a4f5-e37fcb0c4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.933763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016d80d-8f36-41df-a4f5-e37fcb0c4006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:28.934380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016d80d-8f36-41df-a4f5-e37fcb0c4006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.936319 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016d80d-8f36-41df-a4f5-e37fcb0c4006 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.942264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607d525-2387-4ac3-9c9a-fbc3cbee6fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a4aef1c873442fa06739f68f433567, user_id=8561d503d7f04bc2870e1c21fe9b0183, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:28.945012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607d525-2387-4ac3-9c9a-fbc3cbee6fac admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:28.961784 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 965/1933] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:28 2022] PUT /identity/v3/projects/72a4aef1c873442fa06739f68f433567/users/8561d503d7f04bc2870e1c21fe9b0183/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:28.965912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 969/1934] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:28.969733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607d525-2387-4ac3-9c9a-fbc3cbee6fac admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:28.972005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee3cc-4f94-4556-b65c-79ef319e657c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:28.972387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee3cc-4f94-4556-b65c-79ef319e657c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:28.972859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee3cc-4f94-4556-b65c-79ef319e657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.003229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-622ee3cc-4f94-4556-b65c-79ef319e657c None None] MFA Rules not processed for user `8561d503d7f04bc2870e1c21fe9b0183`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:29.004280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:29.004744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-622ee3cc-4f94-4556-b65c-79ef319e657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:29.040324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607d525-2387-4ac3-9c9a-fbc3cbee6fac admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.080190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 970/1935] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:29.084758 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee3cc-4f94-4556-b65c-79ef319e657c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.112081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656f902-e730-473d-a991-e97d1d0e59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.112761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f902-e730-473d-a991-e97d1d0e59bb admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.113044 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f902-e730-473d-a991-e97d1d0e59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.113321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f902-e730-473d-a991-e97d1d0e59bb admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.113963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f902-e730-473d-a991-e97d1d0e59bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.116149 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f902-e730-473d-a991-e97d1d0e59bb admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.145266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 966/1936] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:28 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:29.149646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656f902-e730-473d-a991-e97d1d0e59bb admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.161053 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656f902-e730-473d-a991-e97d1d0e59bb admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.167344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0399c34-1c48-430a-a9d6-71e9cd5ac343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.168518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399c34-1c48-430a-a9d6-71e9cd5ac343 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.168518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399c34-1c48-430a-a9d6-71e9cd5ac343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.168730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0399c34-1c48-430a-a9d6-71e9cd5ac343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.169418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0399c34-1c48-430a-a9d6-71e9cd5ac343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.171018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0399c34-1c48-430a-a9d6-71e9cd5ac343 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.184289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee3cc-4f94-4556-b65c-79ef319e657c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.188012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 967/1937] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:29.189376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0399c34-1c48-430a-a9d6-71e9cd5ac343 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.189737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834620db-c804-4ca0-bf38-6a29c75451ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.190482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834620db-c804-4ca0-bf38-6a29c75451ed admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.190855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834620db-c804-4ca0-bf38-6a29c75451ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.191223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834620db-c804-4ca0-bf38-6a29c75451ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.192192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834620db-c804-4ca0-bf38-6a29c75451ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.194370 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834620db-c804-4ca0-bf38-6a29c75451ed admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.207694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0399c34-1c48-430a-a9d6-71e9cd5ac343 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.217169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013353-bb16-4294-a62a-d6d67e29ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.217800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013353-bb16-4294-a62a-d6d67e29ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.218214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013353-bb16-4294-a62a-d6d67e29ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.218413 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30013353-bb16-4294-a62a-d6d67e29ccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.219182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30013353-bb16-4294-a62a-d6d67e29ccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.220179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:29.222157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30013353-bb16-4294-a62a-d6d67e29ccb7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.235545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 968/1938] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:29.239938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013353-bb16-4294-a62a-d6d67e29ccb7 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.241547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 971/1939] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:29 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:29.246820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834620db-c804-4ca0-bf38-6a29c75451ed admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.255710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30013353-bb16-4294-a62a-d6d67e29ccb7 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.330965 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9b821-f073-4564-b218-7854e4b82899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.331578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b821-f073-4564-b218-7854e4b82899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.331893 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b821-f073-4564-b218-7854e4b82899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.332184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9b821-f073-4564-b218-7854e4b82899 admin admin] PATH_INFO: `/v3/projects/c40cc78916344048b35c944291399668/users/6ddaf1d336754e668e253e66e43df5f5/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.336828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834620db-c804-4ca0-bf38-6a29c75451ed admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.349254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9b821-f073-4564-b218-7854e4b82899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40cc78916344048b35c944291399668, user_id=6ddaf1d336754e668e253e66e43df5f5, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.349668 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799660-7a8e-4b08-82b7-66ede1eec5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.350292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799660-7a8e-4b08-82b7-66ede1eec5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.350575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799660-7a8e-4b08-82b7-66ede1eec5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.350847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799660-7a8e-4b08-82b7-66ede1eec5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.352079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f799660-7a8e-4b08-82b7-66ede1eec5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.353262 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9b821-f073-4564-b218-7854e4b82899 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.354014 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f799660-7a8e-4b08-82b7-66ede1eec5a9 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.373901 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 969/1940] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:29 2022] PUT /identity/v3/projects/c40cc78916344048b35c944291399668/users/6ddaf1d336754e668e253e66e43df5f5/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:29.382229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 972/1941] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:29 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:29.384379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec62da-d860-43e4-a269-3d836f5cbd3e None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.384659 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec62da-d860-43e4-a269-3d836f5cbd3e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.385118 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec62da-d860-43e4-a269-3d836f5cbd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.392671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799660-7a8e-4b08-82b7-66ede1eec5a9 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.408342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799660-7a8e-4b08-82b7-66ede1eec5a9 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.428922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-98ec62da-d860-43e4-a269-3d836f5cbd3e None None] MFA Rules not processed for user `6ddaf1d336754e668e253e66e43df5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:29.430422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-98ec62da-d860-43e4-a269-3d836f5cbd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:29.443443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:29.478663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.479287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.479560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.479866 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.480538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.482303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.493311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 973/1942] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:29.494083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.495675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:29.504511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 970/1943] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:29.508552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec62da-d860-43e4-a269-3d836f5cbd3e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.515438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec62da-d860-43e4-a269-3d836f5cbd3e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.520045 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ec3e-85ef-4691-bb0e-f04ad004171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.520679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ec3e-85ef-4691-bb0e-f04ad004171b admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.520953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ec3e-85ef-4691-bb0e-f04ad004171b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.521221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ec3e-85ef-4691-bb0e-f04ad004171b admin admin] PATH_INFO: `/v3/projects/45762927abb74219a4aaa34975305d75/users/d99c4eb340394664bde4ae1b8ac63590/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.535877 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944ec3e-85ef-4691-bb0e-f04ad004171b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45762927abb74219a4aaa34975305d75, user_id=d99c4eb340394664bde4ae1b8ac63590, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.539676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944ec3e-85ef-4691-bb0e-f04ad004171b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.552510 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 971/1944] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:29 2022] PUT /identity/v3/projects/45762927abb74219a4aaa34975305d75/users/d99c4eb340394664bde4ae1b8ac63590/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:29.553337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ec3e-85ef-4691-bb0e-f04ad004171b admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.557050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a32a9-678d-42ec-910b-cb871343855a admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.590698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:29.612840 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.613463 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.613741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.614511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.616294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:29.624871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ec3e-85ef-4691-bb0e-f04ad004171b admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.630973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ce258-ccef-4d1c-ae8b-edf91ecb87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.631883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ce258-ccef-4d1c-ae8b-edf91ecb87dc admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.632171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ce258-ccef-4d1c-ae8b-edf91ecb87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.632999 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ce258-ccef-4d1c-ae8b-edf91ecb87dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.633727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ce258-ccef-4d1c-ae8b-edf91ecb87dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.635626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ce258-ccef-4d1c-ae8b-edf91ecb87dc admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.670941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 972/1945] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:29 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:29.670941 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ce258-ccef-4d1c-ae8b-edf91ecb87dc admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.687371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.689862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.702025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 974/1946] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:29.702784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.714793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644d5d5-2222-4d45-987f-e9205792d0fd service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.771400 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ce258-ccef-4d1c-ae8b-edf91ecb87dc admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.783966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecd35e-7643-4385-ae88-450a28033b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.783966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd35e-7643-4385-ae88-450a28033b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.783966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd35e-7643-4385-ae88-450a28033b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.783966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd35e-7643-4385-ae88-450a28033b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.784313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecd35e-7643-4385-ae88-450a28033b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.784313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecd35e-7643-4385-ae88-450a28033b53 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.786637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188daf38-b1bf-4bc1-ac62-e482674cb012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.787391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188daf38-b1bf-4bc1-ac62-e482674cb012 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.787680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188daf38-b1bf-4bc1-ac62-e482674cb012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.787986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188daf38-b1bf-4bc1-ac62-e482674cb012 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.788797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188daf38-b1bf-4bc1-ac62-e482674cb012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.790856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188daf38-b1bf-4bc1-ac62-e482674cb012 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.795177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 973/1947] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:29.799042 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecd35e-7643-4385-ae88-450a28033b53 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.809678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecd35e-7643-4385-ae88-450a28033b53 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.814355 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddb51a-23c6-4aa9-be29-28029a8152c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.815274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb51a-23c6-4aa9-be29-28029a8152c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.815427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 975/1948] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:29 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:29.815526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb51a-23c6-4aa9-be29-28029a8152c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.815613 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb51a-23c6-4aa9-be29-28029a8152c6 admin admin] PATH_INFO: `/v3/projects/45762927abb74219a4aaa34975305d75/users/d99c4eb340394664bde4ae1b8ac63590/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.817530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddb51a-23c6-4aa9-be29-28029a8152c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45762927abb74219a4aaa34975305d75, user_id=d99c4eb340394664bde4ae1b8ac63590, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.820459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188daf38-b1bf-4bc1-ac62-e482674cb012 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.820915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddb51a-23c6-4aa9-be29-28029a8152c6 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.827585 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:29.834062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 974/1949] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:29 2022] PUT /identity/v3/projects/45762927abb74219a4aaa34975305d75/users/d99c4eb340394664bde4ae1b8ac63590/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:29.836708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188daf38-b1bf-4bc1-ac62-e482674cb012 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.845923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d012-a880-407f-adab-e62b9bd7e2e4 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.846148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d012-a880-407f-adab-e62b9bd7e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.846427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702d012-a880-407f-adab-e62b9bd7e2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.872923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5702d012-a880-407f-adab-e62b9bd7e2e4 None None] MFA Rules not processed for user `d99c4eb340394664bde4ae1b8ac63590`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:29.874121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5702d012-a880-407f-adab-e62b9bd7e2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:29.894273 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a706-27a4-44f9-bc19-3390faceaf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.895097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a706-27a4-44f9-bc19-3390faceaf0c admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.895387 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a706-27a4-44f9-bc19-3390faceaf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.895659 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a706-27a4-44f9-bc19-3390faceaf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.896330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179a706-27a4-44f9-bc19-3390faceaf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.898520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179a706-27a4-44f9-bc19-3390faceaf0c admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.912973 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 976/1950] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:29.913958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a706-27a4-44f9-bc19-3390faceaf0c admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.924200 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a706-27a4-44f9-bc19-3390faceaf0c admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:29.929151 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db38ffb-7d14-474d-8faf-d740007a7956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:29.929813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db38ffb-7d14-474d-8faf-d740007a7956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:29.930089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db38ffb-7d14-474d-8faf-d740007a7956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:29.930356 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db38ffb-7d14-474d-8faf-d740007a7956 admin admin] PATH_INFO: `/v3/projects/5d231bf1083842a2a7996d3f229419d2/users/b62314c56d354c509db587f4a1add53c/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:29.940181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:29.955518 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db38ffb-7d14-474d-8faf-d740007a7956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d231bf1083842a2a7996d3f229419d2, user_id=b62314c56d354c509db587f4a1add53c, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:29.959143 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db38ffb-7d14-474d-8faf-d740007a7956 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:29.964342 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 975/1951] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:29.975438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702d012-a880-407f-adab-e62b9bd7e2e4 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:29.980501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 977/1952] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:29 2022] PUT /identity/v3/projects/5d231bf1083842a2a7996d3f229419d2/users/b62314c56d354c509db587f4a1add53c/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:29.984500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db38ffb-7d14-474d-8faf-d740007a7956 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:30.037590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702d012-a880-407f-adab-e62b9bd7e2e4 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:30.057646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db38ffb-7d14-474d-8faf-d740007a7956 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:30.062504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3badebc-34b1-4a93-a9e2-6b0d5d555fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:30.063123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3badebc-34b1-4a93-a9e2-6b0d5d555fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.063467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3badebc-34b1-4a93-a9e2-6b0d5d555fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.063744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3badebc-34b1-4a93-a9e2-6b0d5d555fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.064596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3badebc-34b1-4a93-a9e2-6b0d5d555fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:30.066443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3badebc-34b1-4a93-a9e2-6b0d5d555fb1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:30.078143 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 978/1953] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:30.085062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3badebc-34b1-4a93-a9e2-6b0d5d555fb1 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:30.094014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756aa4-5f29-4ca1-a7ee-79e47591055f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:30.094767 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756aa4-5f29-4ca1-a7ee-79e47591055f service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.095068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3badebc-34b1-4a93-a9e2-6b0d5d555fb1 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:30.095171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756aa4-5f29-4ca1-a7ee-79e47591055f service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.095535 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756aa4-5f29-4ca1-a7ee-79e47591055f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.099689 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171af115-49b0-4e0d-bd12-963af0854a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:30.100307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af115-49b0-4e0d-bd12-963af0854a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.100592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af115-49b0-4e0d-bd12-963af0854a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.100873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171af115-49b0-4e0d-bd12-963af0854a98 admin admin] PATH_INFO: `/v3/projects/5d231bf1083842a2a7996d3f229419d2/users/b62314c56d354c509db587f4a1add53c/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.102820 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171af115-49b0-4e0d-bd12-963af0854a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d231bf1083842a2a7996d3f229419d2, user_id=b62314c56d354c509db587f4a1add53c, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:30.105524 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171af115-49b0-4e0d-bd12-963af0854a98 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:30.116480 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 979/1954] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:30 2022] PUT /identity/v3/projects/5d231bf1083842a2a7996d3f229419d2/users/b62314c56d354c509db587f4a1add53c/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:30.128321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420421f8-360f-48bf-8aba-7cd9897af7f0 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.128604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420421f8-360f-48bf-8aba-7cd9897af7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.128884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420421f8-360f-48bf-8aba-7cd9897af7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.148938 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:30.159186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-420421f8-360f-48bf-8aba-7cd9897af7f0 None None] MFA Rules not processed for user `b62314c56d354c509db587f4a1add53c`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:30.160428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-420421f8-360f-48bf-8aba-7cd9897af7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:30.163991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0756aa4-5f29-4ca1-a7ee-79e47591055f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:30.166406 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0756aa4-5f29-4ca1-a7ee-79e47591055f service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:30.178186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 976/1955] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:30.265211 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 980/1956] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:30.273185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756aa4-5f29-4ca1-a7ee-79e47591055f service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:30.282026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756aa4-5f29-4ca1-a7ee-79e47591055f service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:30.338995 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29867a-242f-4d02-a188-110ea288a2a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:30.339624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29867a-242f-4d02-a188-110ea288a2a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.339935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29867a-242f-4d02-a188-110ea288a2a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.340215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29867a-242f-4d02-a188-110ea288a2a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.349664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29867a-242f-4d02-a188-110ea288a2a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:30.351184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29867a-242f-4d02-a188-110ea288a2a6 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:30.361058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 977/1957] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:30.451632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420421f8-360f-48bf-8aba-7cd9897af7f0 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:30.462085 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420421f8-360f-48bf-8aba-7cd9897af7f0 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:30.466538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d7f20-9ca2-4bfd-93e9-5018b93acf7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:30.467326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7f20-9ca2-4bfd-93e9-5018b93acf7d service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:30.467662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7f20-9ca2-4bfd-93e9-5018b93acf7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:30.468128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7f20-9ca2-4bfd-93e9-5018b93acf7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:30.529304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:30.536191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7f20-9ca2-4bfd-93e9-5018b93acf7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:30.538166 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7f20-9ca2-4bfd-93e9-5018b93acf7d service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:30.551870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 981/1958] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:31.026975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29867a-242f-4d02-a188-110ea288a2a6 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:31.161540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29867a-242f-4d02-a188-110ea288a2a6 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:31.171579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:31.172521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:31.174165 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:31.174559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] PATH_INFO: `/v3/users/8561d503d7f04bc2870e1c21fe9b0183` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:31.179385 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8561d503d7f04bc2870e1c21fe9b0183)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:31.184977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:31.304014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8561d503d7f04bc2870e1c21fe9b0183'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:31.324592 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8561d503d7f04bc2870e1c21fe9b0183'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:31.351920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8561d503d7f04bc2870e1c21fe9b0183'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:31.353070 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8561d503d7f04bc2870e1c21fe9b0183'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:31.403761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8561d503d7f04bc2870e1c21fe9b0183'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:31.420234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 978/1959] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:31 2022] DELETE /identity/v3/users/8561d503d7f04bc2870e1c21fe9b0183 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:31.424947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f45b-8d04-4ef2-a18d-124042bd681a None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:31.425240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f45b-8d04-4ef2-a18d-124042bd681a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:31.425516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f45b-8d04-4ef2-a18d-124042bd681a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:31.457485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ac17f45b-8d04-4ef2-a18d-124042bd681a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:31.458687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ac17f45b-8d04-4ef2-a18d-124042bd681a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:31.540182 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 982/1960] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:31.555986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:31.556574 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:31.574310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:31.651923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3be1-63a9-4d52-9938-49528beab3ec admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:31.656536 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaff496-1578-4a9c-a12c-66b8714e856e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:31.657376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff496-1578-4a9c-a12c-66b8714e856e service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:31.657807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff496-1578-4a9c-a12c-66b8714e856e service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:31.658148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff496-1578-4a9c-a12c-66b8714e856e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:31.668731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaff496-1578-4a9c-a12c-66b8714e856e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:31.670210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaff496-1578-4a9c-a12c-66b8714e856e service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:31.681331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 979/1961] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:31.995385 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f45b-8d04-4ef2-a18d-124042bd681a None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:31.996929 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ac17f45b-8d04-4ef2-a18d-124042bd681a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:32.013650 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f45b-8d04-4ef2-a18d-124042bd681a None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:32.018327 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:32.018966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:32.019255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:32.019528 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] PATH_INFO: `/v3/projects/72a4aef1c873442fa06739f68f433567` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:32.020702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a4aef1c873442fa06739f68f433567)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:32.022643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:32.076396 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a4aef1c873442fa06739f68f433567', 'request_id': 'req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.087243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a4aef1c873442fa06739f68f433567', 'request_id': 'req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.096973 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a4aef1c873442fa06739f68f433567', 'request_id': 'req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.112242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] The token cache is being invalidate because project 72a4aef1c873442fa06739f68f433567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:32.112631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.113461 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.119110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 983/1962] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:31 2022] DELETE /identity/v3/projects/72a4aef1c873442fa06739f68f433567 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:32.120067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaff496-1578-4a9c-a12c-66b8714e856e service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:32.142310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaff496-1578-4a9c-a12c-66b8714e856e service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:32.213246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:32.214034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:32.214177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:32.214503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] PATH_INFO: `/v3/users/d99c4eb340394664bde4ae1b8ac63590` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:32.215986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d99c4eb340394664bde4ae1b8ac63590)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:32.217963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:32.280543 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd99c4eb340394664bde4ae1b8ac63590'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.293102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd99c4eb340394664bde4ae1b8ac63590'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.305909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd99c4eb340394664bde4ae1b8ac63590'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.306676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd99c4eb340394664bde4ae1b8ac63590'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.331751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-46aaec80-20e4-49de-9007-3107ae495b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd99c4eb340394664bde4ae1b8ac63590'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:32.343831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 980/1963] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:32 2022] DELETE /identity/v3/users/d99c4eb340394664bde4ae1b8ac63590 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:33.154216 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.155806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:33.234556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7114e-33e8-43f8-a17c-398eb7e02f5e admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.344141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.344835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.345155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.345438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] PATH_INFO: `/v3/projects/45762927abb74219a4aaa34975305d75` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.346623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45762927abb74219a4aaa34975305d75)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.348647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.372944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:33.401008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45762927abb74219a4aaa34975305d75', 'request_id': 'req-df922cc8-a1f4-465b-acb1-327ac481449b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.407762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45762927abb74219a4aaa34975305d75', 'request_id': 'req-df922cc8-a1f4-465b-acb1-327ac481449b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.413379 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45762927abb74219a4aaa34975305d75', 'request_id': 'req-df922cc8-a1f4-465b-acb1-327ac481449b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.426908 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] The token cache is being invalidate because project 45762927abb74219a4aaa34975305d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:33.427411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.428124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.429701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 984/1964] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:33 2022] DELETE /identity/v3/projects/45762927abb74219a4aaa34975305d75 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:33.435624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76866-ddc8-4d54-8d72-efa34b89213b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.436141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76866-ddc8-4d54-8d72-efa34b89213b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.436253 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76866-ddc8-4d54-8d72-efa34b89213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.458513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-f5e76866-ddc8-4d54-8d72-efa34b89213b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:33.459708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f5e76866-ddc8-4d54-8d72-efa34b89213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:33.491791 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:33.526678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.528232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:33.530073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 981/1965] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:33.538022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa532d48-46bb-40a5-8269-8823d6690b22 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.538382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa532d48-46bb-40a5-8269-8823d6690b22 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.538722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa532d48-46bb-40a5-8269-8823d6690b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.541258 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df922cc8-a1f4-465b-acb1-327ac481449b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.546148 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.546871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.547231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.547571 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] PATH_INFO: `/v3/users/6ddaf1d336754e668e253e66e43df5f5` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.548754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddaf1d336754e668e253e66e43df5f5)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.550676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.559848 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-fa532d48-46bb-40a5-8269-8823d6690b22 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:33.562276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-fa532d48-46bb-40a5-8269-8823d6690b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:33.574806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 982/1966] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:33.579913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa532d48-46bb-40a5-8269-8823d6690b22 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.590106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa532d48-46bb-40a5-8269-8823d6690b22 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.594857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.595452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.595738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.596055 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.596770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:33.597052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.598661 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.610496 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddaf1d336754e668e253e66e43df5f5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.611221 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddaf1d336754e668e253e66e43df5f5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.612009 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 983/1967] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:43:33.616203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.617967 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:33.625154 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddaf1d336754e668e253e66e43df5f5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.626037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddaf1d336754e668e253e66e43df5f5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.631303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cc4f5-b175-404a-a6a5-fb1e8582948d admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.637322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54026f6a-f180-44fb-b9b9-d9f74e32e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.637479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b2cd5a-00d1-463e-8149-ed91af7635b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddaf1d336754e668e253e66e43df5f5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:33.637966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54026f6a-f180-44fb-b9b9-d9f74e32e661 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.638349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54026f6a-f180-44fb-b9b9-d9f74e32e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.638664 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54026f6a-f180-44fb-b9b9-d9f74e32e661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.639365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54026f6a-f180-44fb-b9b9-d9f74e32e661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.641310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54026f6a-f180-44fb-b9b9-d9f74e32e661 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.659375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 985/1968] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:33 2022] DELETE /identity/v3/users/6ddaf1d336754e668e253e66e43df5f5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:33.664756 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118f59-cc44-4169-afad-43bcb0265a82 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.664756 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118f59-cc44-4169-afad-43bcb0265a82 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.665121 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118f59-cc44-4169-afad-43bcb0265a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.674071 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 984/1969] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:33 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:33.678131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54026f6a-f180-44fb-b9b9-d9f74e32e661 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.686810 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-3b118f59-cc44-4169-afad-43bcb0265a82 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:33.687979 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3b118f59-cc44-4169-afad-43bcb0265a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:33.754600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 986/1970] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:33.758801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54026f6a-f180-44fb-b9b9-d9f74e32e661 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.763696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d0abd-4653-45bf-9dd4-5587d70370ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.764276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d0abd-4653-45bf-9dd4-5587d70370ec admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.764384 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b118f59-cc44-4169-afad-43bcb0265a82 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.764560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d0abd-4653-45bf-9dd4-5587d70370ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.764837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d0abd-4653-45bf-9dd4-5587d70370ec admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.765477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d0abd-4653-45bf-9dd4-5587d70370ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.765963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-3b118f59-cc44-4169-afad-43bcb0265a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:33.767390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d0abd-4653-45bf-9dd4-5587d70370ec admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.793056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:33.796759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 985/1971] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:33 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:33.800695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d0abd-4653-45bf-9dd4-5587d70370ec admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.813582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d0abd-4653-45bf-9dd4-5587d70370ec admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.818458 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f64e-765f-4f33-80c5-898c60e2d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.819185 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f64e-765f-4f33-80c5-898c60e2d00c admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.819571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f64e-765f-4f33-80c5-898c60e2d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.819968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5f64e-765f-4f33-80c5-898c60e2d00c admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.820619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5f64e-765f-4f33-80c5-898c60e2d00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.822230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5f64e-765f-4f33-80c5-898c60e2d00c admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.832806 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 986/1972] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:33.837510 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f64e-765f-4f33-80c5-898c60e2d00c admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.842027 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b118f59-cc44-4169-afad-43bcb0265a82 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.845627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52db6b4-3105-490c-911f-951e75577e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.846291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52db6b4-3105-490c-911f-951e75577e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.846513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52db6b4-3105-490c-911f-951e75577e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.846785 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52db6b4-3105-490c-911f-951e75577e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.848670 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5f64e-765f-4f33-80c5-898c60e2d00c admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.854456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f7f5f-db74-4ba9-bb4d-142e4fb7480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.855201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7f5f-db74-4ba9-bb4d-142e4fb7480c admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.855490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7f5f-db74-4ba9-bb4d-142e4fb7480c admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.855788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7f5f-db74-4ba9-bb4d-142e4fb7480c admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.856602 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f7f5f-db74-4ba9-bb4d-142e4fb7480c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.858037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f7f5f-db74-4ba9-bb4d-142e4fb7480c admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.858967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52db6b4-3105-490c-911f-951e75577e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.860456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52db6b4-3105-490c-911f-951e75577e87 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.873554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 987/1974] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:33.873755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 987/1974] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:33.874554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f7f5f-db74-4ba9-bb4d-142e4fb7480c admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:33.885071 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f7f5f-db74-4ba9-bb4d-142e4fb7480c admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:33.889889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:33.890552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.890828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.891103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] PATH_INFO: `/v3/projects/f6287b7e0082465a9f5d42bf37fd41ab/users/ea6a03e5d7ed4f08baf3026d74e07737/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.906697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6287b7e0082465a9f5d42bf37fd41ab, user_id=ea6a03e5d7ed4f08baf3026d74e07737, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:33.909624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:33.924184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 988/1975] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:33 2022] PUT /identity/v3/projects/f6287b7e0082465a9f5d42bf37fd41ab/users/ea6a03e5d7ed4f08baf3026d74e07737/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:33.934781 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254cd7-8ded-4b27-bc4e-9a01ec6bb202 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:33.935178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254cd7-8ded-4b27-bc4e-9a01ec6bb202 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:33.935515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254cd7-8ded-4b27-bc4e-9a01ec6bb202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:33.971047 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-72254cd7-8ded-4b27-bc4e-9a01ec6bb202 None None] MFA Rules not processed for user `ea6a03e5d7ed4f08baf3026d74e07737`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:33.972343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-72254cd7-8ded-4b27-bc4e-9a01ec6bb202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:34.050209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 988/1976] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:34.060837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:34.062813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:34.112117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:34.136493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84d1f-75e9-4267-927d-93a311c84281 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:34.142187 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:34.142952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:34.143287 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:34.143642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:34.156285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:34.157742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:34.171154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 989/1977] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:34.317420 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72254cd7-8ded-4b27-bc4e-9a01ec6bb202 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:34.321028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-72254cd7-8ded-4b27-bc4e-9a01ec6bb202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:34.446514 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:34.449038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:34.474871 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72254cd7-8ded-4b27-bc4e-9a01ec6bb202 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:34.481115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:34.481671 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:34.481973 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:34.482426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] PATH_INFO: `/v3/projects/c40cc78916344048b35c944291399668` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:34.483862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40cc78916344048b35c944291399668)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:34.489879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:34.615297 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59063a6-924e-4259-8ceb-9fa304c79751 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:34.620376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40cc78916344048b35c944291399668', 'request_id': 'req-51523730-37fc-472c-9546-1f7e93181c5b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.643741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40cc78916344048b35c944291399668', 'request_id': 'req-51523730-37fc-472c-9546-1f7e93181c5b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.645468 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:34.652953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40cc78916344048b35c944291399668', 'request_id': 'req-51523730-37fc-472c-9546-1f7e93181c5b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.670806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] The token cache is being invalidate because project c40cc78916344048b35c944291399668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:34.671091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.671761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.677336 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 989/1978] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:34 2022] DELETE /identity/v3/projects/c40cc78916344048b35c944291399668 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:34.678673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:34.695368 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:34.780030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:34.780030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:34.780030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:34.780030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] PATH_INFO: `/v3/users/b4333e7a467448f2965202ebeef1cd4f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:34.780641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4333e7a467448f2965202ebeef1cd4f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:34.780641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:34.785410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523730-37fc-472c-9546-1f7e93181c5b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:34.790314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:34.791114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:34.791462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:34.791829 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] PATH_INFO: `/v3/users/b62314c56d354c509db587f4a1add53c` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:34.793119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62314c56d354c509db587f4a1add53c)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:34.795158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:34.845672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4333e7a467448f2965202ebeef1cd4f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.856416 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4333e7a467448f2965202ebeef1cd4f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.867353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4333e7a467448f2965202ebeef1cd4f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.868030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4333e7a467448f2965202ebeef1cd4f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.881567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e6e3f63b-6669-479f-8c46-3f10e1c51ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4333e7a467448f2965202ebeef1cd4f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.885567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62314c56d354c509db587f4a1add53c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.886663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62314c56d354c509db587f4a1add53c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.888594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 990/1979] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:34 2022] DELETE /identity/v3/users/b4333e7a467448f2965202ebeef1cd4f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:34.892682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557f302-212a-4f79-ae4d-39297c0de99b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:34.893716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557f302-212a-4f79-ae4d-39297c0de99b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:34.893716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557f302-212a-4f79-ae4d-39297c0de99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:34.896568 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62314c56d354c509db587f4a1add53c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.897257 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62314c56d354c509db587f4a1add53c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.903221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:34.907299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62314c56d354c509db587f4a1add53c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:34.916929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-2557f302-212a-4f79-ae4d-39297c0de99b None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:34.918835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2557f302-212a-4f79-ae4d-39297c0de99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:34.931035 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 990/1980] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:34 2022] DELETE /identity/v3/users/b62314c56d354c509db587f4a1add53c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:34.992692 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 991/1981] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:35.016950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:35.018779 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:35.111330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5d2e-c78d-45a4-9e4d-084498b99ff4 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:35.116235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:35.117627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.117905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.118172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.135299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:35.205243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:35.206801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:35.217812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 991/1982] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:35.580942 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557f302-212a-4f79-ae4d-39297c0de99b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:35.582289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2557f302-212a-4f79-ae4d-39297c0de99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:35.602780 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557f302-212a-4f79-ae4d-39297c0de99b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:35.611968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:35.612723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.613104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.613475 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] PATH_INFO: `/v3/projects/5d231bf1083842a2a7996d3f229419d2` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.614843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d231bf1083842a2a7996d3f229419d2)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:35.616973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:35.671515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:35.673708 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:35.684418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d231bf1083842a2a7996d3f229419d2', 'request_id': 'req-e788d147-c5d8-4889-b110-a912cc798a02'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.690974 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316cd19-ccbd-4a2a-ab19-3e6dd0dfb687 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:35.706969 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d231bf1083842a2a7996d3f229419d2', 'request_id': 'req-e788d147-c5d8-4889-b110-a912cc798a02'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.731381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d231bf1083842a2a7996d3f229419d2', 'request_id': 'req-e788d147-c5d8-4889-b110-a912cc798a02'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.755142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] The token cache is being invalidate because project 5d231bf1083842a2a7996d3f229419d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:35.755527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.759298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e788d147-c5d8-4889-b110-a912cc798a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.765403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 992/1983] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:35 2022] DELETE /identity/v3/projects/5d231bf1083842a2a7996d3f229419d2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:35.770763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49903ed-8e03-463e-95e0-7b1d866fa6bc None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.771138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49903ed-8e03-463e-95e0-7b1d866fa6bc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.771426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49903ed-8e03-463e-95e0-7b1d866fa6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.810219 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:35.815339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.815626 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.815934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] PATH_INFO: `/v3/users/9179793ad9a749c6ad6b77697d6971bf` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.820969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9179793ad9a749c6ad6b77697d6971bf)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:35.824257 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:35.851194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d49903ed-8e03-463e-95e0-7b1d866fa6bc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:35.853594 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d49903ed-8e03-463e-95e0-7b1d866fa6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:35.864934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 993/1984] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:35.873977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01e41-d3a5-475d-8e87-9fb9ac12910e None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.874911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01e41-d3a5-475d-8e87-9fb9ac12910e None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.876019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01e41-d3a5-475d-8e87-9fb9ac12910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.931558 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-f9b01e41-d3a5-475d-8e87-9fb9ac12910e None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:35.933619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f9b01e41-d3a5-475d-8e87-9fb9ac12910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:35.954150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9179793ad9a749c6ad6b77697d6971bf'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.954150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9179793ad9a749c6ad6b77697d6971bf'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.954526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 994/1985] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:35.957877 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01e41-d3a5-475d-8e87-9fb9ac12910e None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:35.981927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01e41-d3a5-475d-8e87-9fb9ac12910e None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:35.984088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9179793ad9a749c6ad6b77697d6971bf'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.985505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9179793ad9a749c6ad6b77697d6971bf'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:35.990271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:35.991369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:35.991665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:35.991977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:35.993091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:35.993882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:35.998708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.011733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d864ebeb-21d9-4a6b-a332-b4a95be84a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9179793ad9a749c6ad6b77697d6971bf'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:36.039196 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 995/1986] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:36.044064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.049703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.091717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 992/1987] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:35 2022] DELETE /identity/v3/users/9179793ad9a749c6ad6b77697d6971bf => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:36.092083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c61c84-5e43-49e3-a003-b79959a41b99 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.095006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730426c-8e2e-48f5-8f6f-1845d3c51e44 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.095909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730426c-8e2e-48f5-8f6f-1845d3c51e44 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.096331 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730426c-8e2e-48f5-8f6f-1845d3c51e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.141588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b730426c-8e2e-48f5-8f6f-1845d3c51e44 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:36.142849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b730426c-8e2e-48f5-8f6f-1845d3c51e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.170824 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e987e-7d91-49c3-9f69-9abb8948b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.171869 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e987e-7d91-49c3-9f69-9abb8948b833 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.172368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e987e-7d91-49c3-9f69-9abb8948b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.172862 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e987e-7d91-49c3-9f69-9abb8948b833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.173702 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e987e-7d91-49c3-9f69-9abb8948b833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.176192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e987e-7d91-49c3-9f69-9abb8948b833 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.183345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:36.202639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:36.228445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 996/1988] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:36 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:36.230704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e987e-7d91-49c3-9f69-9abb8948b833 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.264208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 993/1989] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:36.278196 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730426c-8e2e-48f5-8f6f-1845d3c51e44 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.281531 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b730426c-8e2e-48f5-8f6f-1845d3c51e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.369549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e987e-7d91-49c3-9f69-9abb8948b833 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.377618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d326a7-c49c-4ad1-9d5a-ff031eb742aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.378362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d326a7-c49c-4ad1-9d5a-ff031eb742aa admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.379308 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d326a7-c49c-4ad1-9d5a-ff031eb742aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.379704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d326a7-c49c-4ad1-9d5a-ff031eb742aa admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.380456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d326a7-c49c-4ad1-9d5a-ff031eb742aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.400199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d326a7-c49c-4ad1-9d5a-ff031eb742aa admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.446285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 997/1990] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:36 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:36.448097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d326a7-c49c-4ad1-9d5a-ff031eb742aa admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.455672 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730426c-8e2e-48f5-8f6f-1845d3c51e44 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.472182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d326a7-c49c-4ad1-9d5a-ff031eb742aa admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.485140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b82a87-39c7-4927-8abb-36d7b2416523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.485709 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b82a87-39c7-4927-8abb-36d7b2416523 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.485990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b82a87-39c7-4927-8abb-36d7b2416523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.486266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b82a87-39c7-4927-8abb-36d7b2416523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.488382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b82a87-39c7-4927-8abb-36d7b2416523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.490344 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b82a87-39c7-4927-8abb-36d7b2416523 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.518492 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 998/1991] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:36.524013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b82a87-39c7-4927-8abb-36d7b2416523 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.556554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b82a87-39c7-4927-8abb-36d7b2416523 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.588535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.589175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.589464 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.589743 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.600388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bec663-aca8-42ba-a334-f2d587f05de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.602171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec663-aca8-42ba-a334-f2d587f05de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.602813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec663-aca8-42ba-a334-f2d587f05de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.603274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec663-aca8-42ba-a334-f2d587f05de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.605353 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec663-aca8-42ba-a334-f2d587f05de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.617804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec663-aca8-42ba-a334-f2d587f05de1 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.618656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.620675 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.648485 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 994/1992] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:36.649637 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.651330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.658212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 999/1993] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:36.661335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bec663-aca8-42ba-a334-f2d587f05de1 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.681448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c32d3-76d4-4653-b19a-f89bbc54d254 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.682427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bec663-aca8-42ba-a334-f2d587f05de1 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:36.701704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.702364 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.702647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.702924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] PATH_INFO: `/v3/projects/fca69e2d75dc4f53baa4fd0c4684cb0b` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.704134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6451642-23b5-4982-b1cf-955ab5e3d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:36.704898 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca69e2d75dc4f53baa4fd0c4684cb0b)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.705646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6451642-23b5-4982-b1cf-955ab5e3d17b admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.706128 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6451642-23b5-4982-b1cf-955ab5e3d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.706593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6451642-23b5-4982-b1cf-955ab5e3d17b admin admin] PATH_INFO: `/v3/projects/8f32e0a8ad46433aa07235a468a2bec1/users/46ea73f69ac5416dac3a8cdddcad87c1/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.706857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.763753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6451642-23b5-4982-b1cf-955ab5e3d17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f32e0a8ad46433aa07235a468a2bec1, user_id=46ea73f69ac5416dac3a8cdddcad87c1, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:36.775601 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6451642-23b5-4982-b1cf-955ab5e3d17b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:36.798899 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1000/1994] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:36 2022] PUT /identity/v3/projects/8f32e0a8ad46433aa07235a468a2bec1/users/46ea73f69ac5416dac3a8cdddcad87c1/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:36.811350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cc39-9e87-4064-b472-c1ff4bb4693d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:36.811650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cc39-9e87-4064-b472-c1ff4bb4693d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:36.811910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cc39-9e87-4064-b472-c1ff4bb4693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:36.860316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca69e2d75dc4f53baa4fd0c4684cb0b', 'request_id': 'req-c607d34c-3d44-4ad1-8a48-346a80aa75c3'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:36.876341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3119cc39-9e87-4064-b472-c1ff4bb4693d None None] MFA Rules not processed for user `46ea73f69ac5416dac3a8cdddcad87c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:36.882112 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca69e2d75dc4f53baa4fd0c4684cb0b', 'request_id': 'req-c607d34c-3d44-4ad1-8a48-346a80aa75c3'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:36.882246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3119cc39-9e87-4064-b472-c1ff4bb4693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.898750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca69e2d75dc4f53baa4fd0c4684cb0b', 'request_id': 'req-c607d34c-3d44-4ad1-8a48-346a80aa75c3'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:36.937808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] The token cache is being invalidate because project fca69e2d75dc4f53baa4fd0c4684cb0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:36.939056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:36.940770 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:36.943608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 995/1995] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:36 2022] DELETE /identity/v3/projects/fca69e2d75dc4f53baa4fd0c4684cb0b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:36.947847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:36.955460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:36.995737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:37.051858 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1001/1996] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:37.056460 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119cc39-9e87-4064-b472-c1ff4bb4693d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.059177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3119cc39-9e87-4064-b472-c1ff4bb4693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:37.086787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:37.093205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d34c-3d44-4ad1-8a48-346a80aa75c3 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.100701 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.103251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.103426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.103835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] PATH_INFO: `/v3/users/b1616b85c4aa4a8896d192a45719fd29` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.105760 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1616b85c4aa4a8896d192a45719fd29)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.108633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.162802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119cc39-9e87-4064-b472-c1ff4bb4693d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.168683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.172773 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.173310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.173610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.174595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.176595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.192998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1616b85c4aa4a8896d192a45719fd29'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.195213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1616b85c4aa4a8896d192a45719fd29'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.208648 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1616b85c4aa4a8896d192a45719fd29'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.209423 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1616b85c4aa4a8896d192a45719fd29'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.219447 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1616b85c4aa4a8896d192a45719fd29'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.226249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1002/1997] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:37 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:37.229560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.231512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:37.242287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 996/1998] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:36 2022] DELETE /identity/v3/users/b1616b85c4aa4a8896d192a45719fd29 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:37.243359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.244936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:37.324454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c24779-4e8c-4d00-b26b-c0f124ba33e6 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.342915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a239854-902d-41c3-8307-3d0fe454222a admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.349021 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f81ad-7613-4930-acd1-00f638856e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.351207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f81ad-7613-4930-acd1-00f638856e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.351892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f81ad-7613-4930-acd1-00f638856e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.352399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f81ad-7613-4930-acd1-00f638856e95 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.353373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f81ad-7613-4930-acd1-00f638856e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.355737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f81ad-7613-4930-acd1-00f638856e95 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.390266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 997/1999] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:37 2022] POST /identity/v3/users => generated 301 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:37.391439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f81ad-7613-4930-acd1-00f638856e95 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.402412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f81ad-7613-4930-acd1-00f638856e95 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.407903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c3c0f-5724-4ab9-9324-bc61ec4b03cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.408707 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c3c0f-5724-4ab9-9324-bc61ec4b03cf admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.409143 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c3c0f-5724-4ab9-9324-bc61ec4b03cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.409573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c3c0f-5724-4ab9-9324-bc61ec4b03cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.410398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c3c0f-5724-4ab9-9324-bc61ec4b03cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.412467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c3c0f-5724-4ab9-9324-bc61ec4b03cf admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.416629 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.417446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.417830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.418641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] PATH_INFO: `/v3/projects/43cc318f72ad4cb4a323f7dd7015639c` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.420716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43cc318f72ad4cb4a323f7dd7015639c)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.423017 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.427173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 998/2000] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:37.428125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c3c0f-5724-4ab9-9324-bc61ec4b03cf admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.445190 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c3c0f-5724-4ab9-9324-bc61ec4b03cf admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.457141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5687f16-be62-4cda-ab93-51b2051ca286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.458040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687f16-be62-4cda-ab93-51b2051ca286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.458412 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687f16-be62-4cda-ab93-51b2051ca286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.458716 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687f16-be62-4cda-ab93-51b2051ca286 admin admin] PATH_INFO: `/v3/projects/c2d11c69cd574e92b8391c8e5bcb34ff/users/a21e7fbf54ab4a5390a4d59f91dcc4ca/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.473800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:37.489455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5687f16-be62-4cda-ab93-51b2051ca286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d11c69cd574e92b8391c8e5bcb34ff, user_id=a21e7fbf54ab4a5390a4d59f91dcc4ca, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.493800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5687f16-be62-4cda-ab93-51b2051ca286 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.510122 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cc318f72ad4cb4a323f7dd7015639c', 'request_id': 'req-edf8fd04-00e2-48ee-af0c-643d7840c145'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.513335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 999/2001] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:37 2022] PUT /identity/v3/projects/c2d11c69cd574e92b8391c8e5bcb34ff/users/a21e7fbf54ab4a5390a4d59f91dcc4ca/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:37.517801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5687f16-be62-4cda-ab93-51b2051ca286 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.520373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:37.524364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cc318f72ad4cb4a323f7dd7015639c', 'request_id': 'req-edf8fd04-00e2-48ee-af0c-643d7840c145'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.537121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cc318f72ad4cb4a323f7dd7015639c', 'request_id': 'req-edf8fd04-00e2-48ee-af0c-643d7840c145'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.574667 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] The token cache is being invalidate because project 43cc318f72ad4cb4a323f7dd7015639c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:37.575109 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.575950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.578112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1003/2002] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:37 2022] DELETE /identity/v3/projects/43cc318f72ad4cb4a323f7dd7015639c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:37.583071 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.587375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:37.652158 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5687f16-be62-4cda-ab93-51b2051ca286 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.664339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.666738 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.667033 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.667887 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.670419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.675489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.689282 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1000/2003] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:37.702642 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.707107 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:37.725568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8fd04-00e2-48ee-af0c-643d7840c145 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.727705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98227070-2b77-4c96-91a3-e6e712770cbb admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.732390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.733476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.733908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.734538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.735237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] PATH_INFO: `/v3/users/c752f57bd1a34da783aac5798a13e032` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.735610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.737410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.737410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] PATH_INFO: `/v3/projects/c2d11c69cd574e92b8391c8e5bcb34ff/users/a21e7fbf54ab4a5390a4d59f91dcc4ca/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.737590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c752f57bd1a34da783aac5798a13e032)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.739030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d11c69cd574e92b8391c8e5bcb34ff, user_id=a21e7fbf54ab4a5390a4d59f91dcc4ca, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.741755 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.741924 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.754436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1001/2004] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:37 2022] PUT /identity/v3/projects/c2d11c69cd574e92b8391c8e5bcb34ff/users/a21e7fbf54ab4a5390a4d59f91dcc4ca/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:37.755582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:37.762564 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:37.846225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c752f57bd1a34da783aac5798a13e032'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.851301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85a1cf-912f-4b5d-8b4b-c20f6f7c7805 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:37.855854 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c752f57bd1a34da783aac5798a13e032'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.857819 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:37.858927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.859252 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.860112 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] PATH_INFO: `/v3/projects/2b7b31b3b8204a6bbf69ae623b8f21a0` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.861532 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7b31b3b8204a6bbf69ae623b8f21a0)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:37.863512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:37.868562 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c752f57bd1a34da783aac5798a13e032'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.869312 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c752f57bd1a34da783aac5798a13e032'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.889560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-944cc000-c84b-499e-bcb0-6f652e24cfee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c752f57bd1a34da783aac5798a13e032'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.901612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1004/2005] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:37 2022] DELETE /identity/v3/users/c752f57bd1a34da783aac5798a13e032 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:37.903235 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3d62-451f-428e-a5db-c09116971ede None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:37.903521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3d62-451f-428e-a5db-c09116971ede None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:37.903950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e3d62-451f-428e-a5db-c09116971ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:37.957207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-636e3d62-451f-428e-a5db-c09116971ede None None] MFA Rules not processed for user `a21e7fbf54ab4a5390a4d59f91dcc4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:37.958506 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-636e3d62-451f-428e-a5db-c09116971ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:37.973916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7b31b3b8204a6bbf69ae623b8f21a0', 'request_id': 'req-18b09edc-257a-4ace-9f67-931e7799adc8'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.986475 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7b31b3b8204a6bbf69ae623b8f21a0', 'request_id': 'req-18b09edc-257a-4ace-9f67-931e7799adc8'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:37.998306 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7b31b3b8204a6bbf69ae623b8f21a0', 'request_id': 'req-18b09edc-257a-4ace-9f67-931e7799adc8'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.026185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:38.035130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] The token cache is being invalidate because project 2b7b31b3b8204a6bbf69ae623b8f21a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:38.037446 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.040163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.042619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1002/2006] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:37 2022] DELETE /identity/v3/projects/2b7b31b3b8204a6bbf69ae623b8f21a0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:38.047280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.050535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.061989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:38.108154 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1005/2007] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:38.119138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e3d62-451f-428e-a5db-c09116971ede None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.121497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-636e3d62-451f-428e-a5db-c09116971ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.212033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e3d62-451f-428e-a5db-c09116971ede None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:38.212909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b09edc-257a-4ace-9f67-931e7799adc8 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:38.216892 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:38.217881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.218408 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.218751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:38.219244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.219589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.220119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.220570 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] PATH_INFO: `/v3/users/f67d0006c63d4e8b8ba667b4cdb8c753` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.221834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67d0006c63d4e8b8ba667b4cdb8c753)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:38.224773 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:38.232730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:38.234631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:38.251383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1006/2008] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:38.252749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.254345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.275077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce761-7cf9-48ff-9154-2c985f6d58e1 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:38.282564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:38.283278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.283630 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.284011 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] PATH_INFO: `/v3/users/ea6a03e5d7ed4f08baf3026d74e07737` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.286292 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6a03e5d7ed4f08baf3026d74e07737)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:38.301921 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:38.334079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67d0006c63d4e8b8ba667b4cdb8c753'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.335648 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67d0006c63d4e8b8ba667b4cdb8c753'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.352505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67d0006c63d4e8b8ba667b4cdb8c753'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.353359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67d0006c63d4e8b8ba667b4cdb8c753'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.370043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67d0006c63d4e8b8ba667b4cdb8c753'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.421896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1003/2009] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:38 2022] DELETE /identity/v3/users/f67d0006c63d4e8b8ba667b4cdb8c753 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:38.432171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6a03e5d7ed4f08baf3026d74e07737'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.442503 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6a03e5d7ed4f08baf3026d74e07737'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.455690 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.457959 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.465289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6a03e5d7ed4f08baf3026d74e07737'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.466652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6a03e5d7ed4f08baf3026d74e07737'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.488033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6a03e5d7ed4f08baf3026d74e07737'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.503834 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1007/2010] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:38 2022] DELETE /identity/v3/users/ea6a03e5d7ed4f08baf3026d74e07737 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:38.505621 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.510132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.609831 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2151-3159-481d-958a-3227899736f7 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:38.612223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735c551-850e-4056-a46a-c76955accf30 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:38.617049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:38.618052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.618684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.619394 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] PATH_INFO: `/v3/projects/77a29eda34af4eb3bf338115127aad98` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.621231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:38.622069 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.622424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a29eda34af4eb3bf338115127aad98)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:38.622576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.622915 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] PATH_INFO: `/v3/users/46ea73f69ac5416dac3a8cdddcad87c1` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.624325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ea73f69ac5416dac3a8cdddcad87c1)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:38.626091 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:38.626693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:38.631525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:38.655627 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:38.703121 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a29eda34af4eb3bf338115127aad98', 'request_id': 'req-6e110729-5b79-40aa-bb69-dc8efd18039e'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.710074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a29eda34af4eb3bf338115127aad98', 'request_id': 'req-6e110729-5b79-40aa-bb69-dc8efd18039e'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.712318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ea73f69ac5416dac3a8cdddcad87c1'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.713264 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ea73f69ac5416dac3a8cdddcad87c1'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.721149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ea73f69ac5416dac3a8cdddcad87c1'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.721498 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a29eda34af4eb3bf338115127aad98', 'request_id': 'req-6e110729-5b79-40aa-bb69-dc8efd18039e'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.722765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ea73f69ac5416dac3a8cdddcad87c1'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.731269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3ddb825-3e7b-4c80-af7b-2bfa44c0751a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ea73f69ac5416dac3a8cdddcad87c1'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.737579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] The token cache is being invalidate because project 77a29eda34af4eb3bf338115127aad98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:38.738104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.738733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-6e110729-5b79-40aa-bb69-dc8efd18039e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:38.740485 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1008/2011] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:38 2022] DELETE /identity/v3/projects/77a29eda34af4eb3bf338115127aad98 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:38.745714 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040107-3329-4a59-bf14-1618130ff96a None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.746520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040107-3329-4a59-bf14-1618130ff96a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.746808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040107-3329-4a59-bf14-1618130ff96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.760950 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1004/2012] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:38 2022] DELETE /identity/v3/users/46ea73f69ac5416dac3a8cdddcad87c1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:38.769227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-53040107-3329-4a59-bf14-1618130ff96a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:38.770622 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-53040107-3329-4a59-bf14-1618130ff96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.776445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc6e9-b88f-4533-a759-c3d5188f3f61 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.776960 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc6e9-b88f-4533-a759-c3d5188f3f61 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.777610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc6e9-b88f-4533-a759-c3d5188f3f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.818904 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-447dc6e9-b88f-4533-a759-c3d5188f3f61 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:38.821036 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-447dc6e9-b88f-4533-a759-c3d5188f3f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.842871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1009/2013] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:38.845056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390309dc-8628-4b2c-bd69-9a89825c0274 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:38.845458 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390309dc-8628-4b2c-bd69-9a89825c0274 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:38.851887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390309dc-8628-4b2c-bd69-9a89825c0274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:38.890859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-390309dc-8628-4b2c-bd69-9a89825c0274 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:38.892130 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-390309dc-8628-4b2c-bd69-9a89825c0274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.901274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1010/2014] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:38.902125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390309dc-8628-4b2c-bd69-9a89825c0274 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.903643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-390309dc-8628-4b2c-bd69-9a89825c0274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.921231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1005/2015] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:38.922212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dc6e9-b88f-4533-a759-c3d5188f3f61 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:38.923678 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-447dc6e9-b88f-4533-a759-c3d5188f3f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:38.998422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dc6e9-b88f-4533-a759-c3d5188f3f61 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.002509 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7faf2-d207-4b1b-9874-90ed6005ab2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.003063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7faf2-d207-4b1b-9874-90ed6005ab2e service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.003346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7faf2-d207-4b1b-9874-90ed6005ab2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.003801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7faf2-d207-4b1b-9874-90ed6005ab2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.026620 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390309dc-8628-4b2c-bd69-9a89825c0274 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.039394 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7faf2-d207-4b1b-9874-90ed6005ab2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.040955 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7faf2-d207-4b1b-9874-90ed6005ab2e service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.053474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1006/2016] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:39.055936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a25bf-106f-4e91-adc8-bdadef5885cd None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.056229 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a25bf-106f-4e91-adc8-bdadef5885cd None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.056506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a25bf-106f-4e91-adc8-bdadef5885cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.060575 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb4295-38ff-4c4b-8ac3-71f5edf191ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.061241 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4295-38ff-4c4b-8ac3-71f5edf191ee service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.061625 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4295-38ff-4c4b-8ac3-71f5edf191ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.061794 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4295-38ff-4c4b-8ac3-71f5edf191ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.078220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb4295-38ff-4c4b-8ac3-71f5edf191ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.080553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb4295-38ff-4c4b-8ac3-71f5edf191ee service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.080965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-5a6a25bf-106f-4e91-adc8-bdadef5885cd None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:39.082192 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5a6a25bf-106f-4e91-adc8-bdadef5885cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:39.094146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1007/2017] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:39.095260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a25bf-106f-4e91-adc8-bdadef5885cd None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.096658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1011/2018] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:39.097108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5a6a25bf-106f-4e91-adc8-bdadef5885cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:39.099643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb4295-38ff-4c4b-8ac3-71f5edf191ee service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.112235 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a25bf-106f-4e91-adc8-bdadef5885cd None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.115994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb4295-38ff-4c4b-8ac3-71f5edf191ee service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.118215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.118961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.119243 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.119652 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] PATH_INFO: `/v3/projects/b3175ac9c49c41598a4d6cccb94d95d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.120833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3175ac9c49c41598a4d6cccb94d95d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.122769 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.123172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.124488 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.124879 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.125472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.126315 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:39.126743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.129487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.147289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1012/2019] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:39.148643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.164244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cbcea-04f0-4814-ae40-fc13bb0a1e36 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.171157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2c47e-c1b7-425e-9987-f9e4910698f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.172265 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2c47e-c1b7-425e-9987-f9e4910698f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.172551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2c47e-c1b7-425e-9987-f9e4910698f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.174681 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2c47e-c1b7-425e-9987-f9e4910698f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.175352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2c47e-c1b7-425e-9987-f9e4910698f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.179859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2c47e-c1b7-425e-9987-f9e4910698f5 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.184910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:39.203673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3175ac9c49c41598a4d6cccb94d95d4', 'request_id': 'req-23e17ecb-daad-4507-b75e-0ac13e780cc6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.213139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:39.214095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3175ac9c49c41598a4d6cccb94d95d4', 'request_id': 'req-23e17ecb-daad-4507-b75e-0ac13e780cc6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.223147 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3175ac9c49c41598a4d6cccb94d95d4', 'request_id': 'req-23e17ecb-daad-4507-b75e-0ac13e780cc6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.237304 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1013/2020] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:39.242945 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2c47e-c1b7-425e-9987-f9e4910698f5 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.244881 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] The token cache is being invalidate because project b3175ac9c49c41598a4d6cccb94d95d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:39.245253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.246104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-23e17ecb-daad-4507-b75e-0ac13e780cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:39.247729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1008/2021] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:39 2022] DELETE /identity/v3/projects/b3175ac9c49c41598a4d6cccb94d95d4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:39.261250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb5497-c12d-46d4-b5d1-691b898fbc69 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.261541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb5497-c12d-46d4-b5d1-691b898fbc69 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.261812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb5497-c12d-46d4-b5d1-691b898fbc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.314526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4deb5497-c12d-46d4-b5d1-691b898fbc69 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:39.316241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4deb5497-c12d-46d4-b5d1-691b898fbc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:39.333318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2c47e-c1b7-425e-9987-f9e4910698f5 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.336368 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1009/2022] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:39.343490 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.344549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6959-bdf8-43e1-96f5-ac9586ed5f7c None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.345172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6959-bdf8-43e1-96f5-ac9586ed5f7c None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.345661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6959-bdf8-43e1-96f5-ac9586ed5f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.349314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.349742 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.350047 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.350819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.356557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.373939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-052a6959-bdf8-43e1-96f5-ac9586ed5f7c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:39.375266 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-052a6959-bdf8-43e1-96f5-ac9586ed5f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:39.387371 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1010/2023] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:39.392459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a6959-bdf8-43e1-96f5-ac9586ed5f7c None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.401450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1014/2024] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:39.405443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.408752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:39.418456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a6959-bdf8-43e1-96f5-ac9586ed5f7c None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.434044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.434739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.435024 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.435293 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.435978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:39.436294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.442949 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.471224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1011/2025] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:39.476110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.495140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb6046-38d4-4bd6-9150-32159b19adee admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.500787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b81be-8000-4dff-be38-e549d7b640ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.501493 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b81be-8000-4dff-be38-e549d7b640ae admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.501777 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b81be-8000-4dff-be38-e549d7b640ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.502049 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b81be-8000-4dff-be38-e549d7b640ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.502688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b81be-8000-4dff-be38-e549d7b640ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.504805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b81be-8000-4dff-be38-e549d7b640ae admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.506504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1eec7-bf0e-43fd-bd9f-3e6ea2c777ca admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.517825 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9b864-c3d3-4b78-b14b-3b2ee7dc4152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.519536 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9b864-c3d3-4b78-b14b-3b2ee7dc4152 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.520103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9b864-c3d3-4b78-b14b-3b2ee7dc4152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.520589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9b864-c3d3-4b78-b14b-3b2ee7dc4152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.521678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9b864-c3d3-4b78-b14b-3b2ee7dc4152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.532504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9b864-c3d3-4b78-b14b-3b2ee7dc4152 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.543501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1012/2026] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:39.544667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b81be-8000-4dff-be38-e549d7b640ae admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.550202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1015/2027] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:39.555041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9b864-c3d3-4b78-b14b-3b2ee7dc4152 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.569476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9b864-c3d3-4b78-b14b-3b2ee7dc4152 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.632686 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b81be-8000-4dff-be38-e549d7b640ae admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.644197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40d214-2c89-4156-bd0a-a89a081c7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.644791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d214-2c89-4156-bd0a-a89a081c7bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.645068 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d214-2c89-4156-bd0a-a89a081c7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.646888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d214-2c89-4156-bd0a-a89a081c7bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.648625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40d214-2c89-4156-bd0a-a89a081c7bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.661806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40d214-2c89-4156-bd0a-a89a081c7bc3 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.689822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68240b14-bd39-4cd5-9893-8f2c4d212e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.696741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68240b14-bd39-4cd5-9893-8f2c4d212e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.697026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68240b14-bd39-4cd5-9893-8f2c4d212e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.697306 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68240b14-bd39-4cd5-9893-8f2c4d212e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.699725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68240b14-bd39-4cd5-9893-8f2c4d212e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.704601 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68240b14-bd39-4cd5-9893-8f2c4d212e68 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.727362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1016/2028] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:39.728552 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68240b14-bd39-4cd5-9893-8f2c4d212e68 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.735092 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1013/2029] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:39 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:39.737163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40d214-2c89-4156-bd0a-a89a081c7bc3 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.742617 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68240b14-bd39-4cd5-9893-8f2c4d212e68 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.759125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37416d5-91a4-4cb3-aa2f-53cf92f10b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.759884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37416d5-91a4-4cb3-aa2f-53cf92f10b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.760341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37416d5-91a4-4cb3-aa2f-53cf92f10b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.760658 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37416d5-91a4-4cb3-aa2f-53cf92f10b26 admin admin] PATH_INFO: `/v3/projects/8cdef92bfda143eab568e5bd009e558b/users/4ad3c7587a99494a951498b552c05232/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.784428 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40d214-2c89-4156-bd0a-a89a081c7bc3 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.799051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:39.799621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:39.800008 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37416d5-91a4-4cb3-aa2f-53cf92f10b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdef92bfda143eab568e5bd009e558b, user_id=4ad3c7587a99494a951498b552c05232, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.804851 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:39.805359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:39.806141 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:39.808173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.808371 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37416d5-91a4-4cb3-aa2f-53cf92f10b26 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:39.840383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1014/2030] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:39.841454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.847146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:39.865357 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1017/2031] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:39 2022] PUT /identity/v3/projects/8cdef92bfda143eab568e5bd009e558b/users/4ad3c7587a99494a951498b552c05232/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:39.875744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37416d5-91a4-4cb3-aa2f-53cf92f10b26 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:39.889790 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8449e1e-65c5-4fd0-a5a9-aeae1bd1631b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:39.987410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:40.010046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.010390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.010928 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.011037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] PATH_INFO: `/v3/projects/f6287b7e0082465a9f5d42bf37fd41ab` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.012427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6287b7e0082465a9f5d42bf37fd41ab)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.014699 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.017672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:40.052073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37416d5-91a4-4cb3-aa2f-53cf92f10b26 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.056224 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63d83f-414f-4cfd-b287-bd3277351f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.056856 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63d83f-414f-4cfd-b287-bd3277351f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.057302 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63d83f-414f-4cfd-b287-bd3277351f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.057577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63d83f-414f-4cfd-b287-bd3277351f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.058232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63d83f-414f-4cfd-b287-bd3277351f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.059904 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63d83f-414f-4cfd-b287-bd3277351f1b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.077294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1018/2032] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:40.077294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedceb0-9a77-4404-9f0e-95505d1758d6 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.077294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedceb0-9a77-4404-9f0e-95505d1758d6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.077294 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedceb0-9a77-4404-9f0e-95505d1758d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.109176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3bedceb0-9a77-4404-9f0e-95505d1758d6 None None] MFA Rules not processed for user `4ad3c7587a99494a951498b552c05232`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:40.110944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3bedceb0-9a77-4404-9f0e-95505d1758d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.113573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6287b7e0082465a9f5d42bf37fd41ab', 'request_id': 'req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.123017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6287b7e0082465a9f5d42bf37fd41ab', 'request_id': 'req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.131505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6287b7e0082465a9f5d42bf37fd41ab', 'request_id': 'req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.157511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] The token cache is being invalidate because project f6287b7e0082465a9f5d42bf37fd41ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:40.157987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.161074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.163569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1015/2033] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:39 2022] DELETE /identity/v3/projects/f6287b7e0082465a9f5d42bf37fd41ab => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:40.165403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.167944 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.208093 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1019/2034] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:40.212349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedceb0-9a77-4404-9f0e-95505d1758d6 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.213744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3bedceb0-9a77-4404-9f0e-95505d1758d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.263197 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a7a1f-8f7a-407c-926f-8ca00a0e9c32 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.270482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.273128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.273609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.274073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] PATH_INFO: `/v3/projects/8f32e0a8ad46433aa07235a468a2bec1` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.275751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f32e0a8ad46433aa07235a468a2bec1)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.278256 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.310052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedceb0-9a77-4404-9f0e-95505d1758d6 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.316019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8e1a2-8226-486d-93de-d7e7c8fbc38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.316989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8e1a2-8226-486d-93de-d7e7c8fbc38f admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.317367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8e1a2-8226-486d-93de-d7e7c8fbc38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.317651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8e1a2-8226-486d-93de-d7e7c8fbc38f admin admin] PATH_INFO: `/v3/projects/cbf6e89e98724d2d81ae20aea11a8c75/users/c9fa6c10a7024096b7e9c53d821ddb8c/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.338698 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8e1a2-8226-486d-93de-d7e7c8fbc38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf6e89e98724d2d81ae20aea11a8c75, user_id=c9fa6c10a7024096b7e9c53d821ddb8c, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.342119 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8e1a2-8226-486d-93de-d7e7c8fbc38f admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.351529 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f32e0a8ad46433aa07235a468a2bec1', 'request_id': 'req-d99edd45-5227-46c3-b2b7-5f60131657cd'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.358900 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f32e0a8ad46433aa07235a468a2bec1', 'request_id': 'req-d99edd45-5227-46c3-b2b7-5f60131657cd'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.363887 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1020/2035] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:40 2022] PUT /identity/v3/projects/cbf6e89e98724d2d81ae20aea11a8c75/users/c9fa6c10a7024096b7e9c53d821ddb8c/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:40.365438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b061b3-11dc-4c78-a5e0-7d9c5f56cfd6 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.365928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b061b3-11dc-4c78-a5e0-7d9c5f56cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.366580 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b061b3-11dc-4c78-a5e0-7d9c5f56cfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.368551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f32e0a8ad46433aa07235a468a2bec1', 'request_id': 'req-d99edd45-5227-46c3-b2b7-5f60131657cd'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.391822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-31b061b3-11dc-4c78-a5e0-7d9c5f56cfd6 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:40.393387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-31b061b3-11dc-4c78-a5e0-7d9c5f56cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.395046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] The token cache is being invalidate because project 8f32e0a8ad46433aa07235a468a2bec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:40.395456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.396317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.399497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1016/2036] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:40 2022] DELETE /identity/v3/projects/8f32e0a8ad46433aa07235a468a2bec1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:40.401301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.402945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.418105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:40.452135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:40.469701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1021/2037] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:40.471298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343df8-258e-4c6a-9aca-0398b9faa842 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.471650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343df8-258e-4c6a-9aca-0398b9faa842 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.472016 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74343df8-258e-4c6a-9aca-0398b9faa842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.514607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-74343df8-258e-4c6a-9aca-0398b9faa842 None None] MFA Rules not processed for user `c9fa6c10a7024096b7e9c53d821ddb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:40.516269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-74343df8-258e-4c6a-9aca-0398b9faa842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.534251 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99edd45-5227-46c3-b2b7-5f60131657cd admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.540763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.541253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.541607 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.541951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.542710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.544984 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.580593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1017/2038] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:40.581444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.585275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.593863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1022/2039] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:40.594950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc03fc-ad69-4311-9477-d243c4817726 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.595240 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc03fc-ad69-4311-9477-d243c4817726 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.595517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc03fc-ad69-4311-9477-d243c4817726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.615857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-00fc03fc-ad69-4311-9477-d243c4817726 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:40.617610 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-00fc03fc-ad69-4311-9477-d243c4817726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.658323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36923eab-924f-4a39-9f66-3c45e869f631 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.665017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.665748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.666034 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.666317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] PATH_INFO: `/v3/users/a21e7fbf54ab4a5390a4d59f91dcc4ca` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.667639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21e7fbf54ab4a5390a4d59f91dcc4ca)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.670166 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.696666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1023/2040] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:40.698184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc03fc-ad69-4311-9477-d243c4817726 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.713981 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc03fc-ad69-4311-9477-d243c4817726 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.721462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.722347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.722640 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.723001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.724802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.727321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.756706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21e7fbf54ab4a5390a4d59f91dcc4ca'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.760439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21e7fbf54ab4a5390a4d59f91dcc4ca'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.768606 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1024/2041] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/users => generated 299 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:40.771079 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.772388 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21e7fbf54ab4a5390a4d59f91dcc4ca'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.773109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21e7fbf54ab4a5390a4d59f91dcc4ca'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.774085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.782696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21e7fbf54ab4a5390a4d59f91dcc4ca'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:40.788396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0139fc8-eb1a-4450-8b48-0fca446198f4 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.794652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:40.795364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:40.796170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:40.796452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:40.797100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:40.799028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:40.806227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1018/2042] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:40 2022] DELETE /identity/v3/users/a21e7fbf54ab4a5390a4d59f91dcc4ca => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:40.807164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.810407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.829106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:40.850139 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1025/2043] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:40 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:40.851879 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:40.854445 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:40.951877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e75bc5-2e9a-4415-b254-808c4db6b4f4 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:40.965101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:41.006251 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6db60-3676-45b5-a5ab-24fb3a5ebc3e admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.013549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ab7fe-40bc-4cea-b91e-242dbe96e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.014352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab7fe-40bc-4cea-b91e-242dbe96e439 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.014694 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab7fe-40bc-4cea-b91e-242dbe96e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.015545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ab7fe-40bc-4cea-b91e-242dbe96e439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.016273 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ab7fe-40bc-4cea-b91e-242dbe96e439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.018690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ab7fe-40bc-4cea-b91e-242dbe96e439 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.033400 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1026/2044] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:41.034248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ab7fe-40bc-4cea-b91e-242dbe96e439 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.048178 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ab7fe-40bc-4cea-b91e-242dbe96e439 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.057372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9189f3-e108-4f6c-aa97-30b258170d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.058179 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9189f3-e108-4f6c-aa97-30b258170d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.058563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9189f3-e108-4f6c-aa97-30b258170d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.059123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9189f3-e108-4f6c-aa97-30b258170d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.059931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9189f3-e108-4f6c-aa97-30b258170d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.062784 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9189f3-e108-4f6c-aa97-30b258170d05 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.078255 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.078884 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.079166 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.080376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.081393 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:41.081733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.083543 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.096641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1027/2045] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/users => generated 292 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:41.097927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9189f3-e108-4f6c-aa97-30b258170d05 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.099892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1019/2046] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:41.102996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.115195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9189f3-e108-4f6c-aa97-30b258170d05 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.118983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d178c-e925-4eb0-8276-57b9137f49fa admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.125772 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05585-c1cd-4444-9f51-84ec25729e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.126462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05585-c1cd-4444-9f51-84ec25729e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.127202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05585-c1cd-4444-9f51-84ec25729e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.127202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05585-c1cd-4444-9f51-84ec25729e7a admin admin] PATH_INFO: `/v3/projects/b1aaa689474c46269642cc52930b63e1/users/0c73ecfb02974ac9b704286a26ae14d5/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.134791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2fe10-3381-4ebd-8e43-ae61f9414286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.135432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fe10-3381-4ebd-8e43-ae61f9414286 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.135715 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fe10-3381-4ebd-8e43-ae61f9414286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.136015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fe10-3381-4ebd-8e43-ae61f9414286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.136664 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2fe10-3381-4ebd-8e43-ae61f9414286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.141108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2fe10-3381-4ebd-8e43-ae61f9414286 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.144753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05585-c1cd-4444-9f51-84ec25729e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aaa689474c46269642cc52930b63e1, user_id=0c73ecfb02974ac9b704286a26ae14d5, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.147457 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05585-c1cd-4444-9f51-84ec25729e7a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.159520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1020/2047] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:41.160421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2fe10-3381-4ebd-8e43-ae61f9414286 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.170250 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1028/2048] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:41 2022] PUT /identity/v3/projects/b1aaa689474c46269642cc52930b63e1/users/0c73ecfb02974ac9b704286a26ae14d5/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:41.171205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05585-c1cd-4444-9f51-84ec25729e7a admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.175237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2fe10-3381-4ebd-8e43-ae61f9414286 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.271241 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05585-c1cd-4444-9f51-84ec25729e7a admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.274727 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.275227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.275680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.276294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.277011 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.279124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.279511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d180b8-4011-4383-ade8-20e6aa92ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.280471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d180b8-4011-4383-ade8-20e6aa92ebc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.280943 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d180b8-4011-4383-ade8-20e6aa92ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.281455 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d180b8-4011-4383-ade8-20e6aa92ebc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.282463 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d180b8-4011-4383-ade8-20e6aa92ebc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.284479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d180b8-4011-4383-ade8-20e6aa92ebc9 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.298379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1029/2049] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:41.299415 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d180b8-4011-4383-ade8-20e6aa92ebc9 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.311983 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d180b8-4011-4383-ade8-20e6aa92ebc9 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.319980 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a340-d2e5-4914-80b2-909af96e8f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.320181 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1021/2050] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:41.320285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a340-d2e5-4914-80b2-909af96e8f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.320285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a340-d2e5-4914-80b2-909af96e8f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.320456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.320547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a340-d2e5-4914-80b2-909af96e8f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.320547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58a340-d2e5-4914-80b2-909af96e8f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.321087 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58a340-d2e5-4914-80b2-909af96e8f6e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.323685 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.333365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1030/2051] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:41.333365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a340-d2e5-4914-80b2-909af96e8f6e admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.345757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a340-d2e5-4914-80b2-909af96e8f6e admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.365044 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:41.407073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cae2e7-8988-4d05-b94a-69aa6ac9c0dd admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.412721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.413512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.414703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69326a99-d333-4bf7-a36e-065b98befb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.414917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.415679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326a99-d333-4bf7-a36e-065b98befb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.415833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] PATH_INFO: `/v3/projects/c2d11c69cd574e92b8391c8e5bcb34ff` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.415932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326a99-d333-4bf7-a36e-065b98befb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.416075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326a99-d333-4bf7-a36e-065b98befb15 admin admin] PATH_INFO: `/v3/projects/04fbb8e062b2471e80b63127063c72e1/users/49819fc8619948779b72c46175028b75/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.416651 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d11c69cd574e92b8391c8e5bcb34ff)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.419054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.441832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69326a99-d333-4bf7-a36e-065b98befb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fbb8e062b2471e80b63127063c72e1, user_id=49819fc8619948779b72c46175028b75, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.445218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69326a99-d333-4bf7-a36e-065b98befb15 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.471590 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1031/2052] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:41 2022] PUT /identity/v3/projects/04fbb8e062b2471e80b63127063c72e1/users/49819fc8619948779b72c46175028b75/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:41.472678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69326a99-d333-4bf7-a36e-065b98befb15 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.492386 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:41.499635 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d11c69cd574e92b8391c8e5bcb34ff', 'request_id': 'req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:41.507343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d11c69cd574e92b8391c8e5bcb34ff', 'request_id': 'req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:41.513515 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d11c69cd574e92b8391c8e5bcb34ff', 'request_id': 'req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:41.528890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] The token cache is being invalidate because project c2d11c69cd574e92b8391c8e5bcb34ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:41.529189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:41.529843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:41.531641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1022/2053] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:41 2022] DELETE /identity/v3/projects/c2d11c69cd574e92b8391c8e5bcb34ff => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:41.535461 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.537471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.555743 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69326a99-d333-4bf7-a36e-065b98befb15 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.611204 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec68e-9bc0-4c33-a9f5-2cc0c2b91bf9 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.616937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609a4d3-d730-4322-9e33-00cf346f5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.617706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a4d3-d730-4322-9e33-00cf346f5dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.618063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a4d3-d730-4322-9e33-00cf346f5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.618516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a4d3-d730-4322-9e33-00cf346f5dfc admin admin] PATH_INFO: `/v3/projects/b1aaa689474c46269642cc52930b63e1/users/0c73ecfb02974ac9b704286a26ae14d5/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.620427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2174f5e-9091-40d0-aa86-d7efd1102b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.620567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609a4d3-d730-4322-9e33-00cf346f5dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aaa689474c46269642cc52930b63e1, user_id=0c73ecfb02974ac9b704286a26ae14d5, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.621173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174f5e-9091-40d0-aa86-d7efd1102b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.621453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174f5e-9091-40d0-aa86-d7efd1102b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.621724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174f5e-9091-40d0-aa86-d7efd1102b61 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.622354 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2174f5e-9091-40d0-aa86-d7efd1102b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.623718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609a4d3-d730-4322-9e33-00cf346f5dfc admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.624871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2174f5e-9091-40d0-aa86-d7efd1102b61 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.636506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1023/2054] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:41 2022] PUT /identity/v3/projects/b1aaa689474c46269642cc52930b63e1/users/0c73ecfb02974ac9b704286a26ae14d5/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:41.637773 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128661-3bb7-4675-aa39-fa9bd86b0e35 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.638061 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128661-3bb7-4675-aa39-fa9bd86b0e35 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.638339 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128661-3bb7-4675-aa39-fa9bd86b0e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.649571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1032/2055] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:41.650819 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d723c19-faee-4b9a-8a15-5559b086aebc None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.651102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d723c19-faee-4b9a-8a15-5559b086aebc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.651373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d723c19-faee-4b9a-8a15-5559b086aebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.671957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-58128661-3bb7-4675-aa39-fa9bd86b0e35 None None] MFA Rules not processed for user `49819fc8619948779b72c46175028b75`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:41.673253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-58128661-3bb7-4675-aa39-fa9bd86b0e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.673805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7d723c19-faee-4b9a-8a15-5559b086aebc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:41.675080 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7d723c19-faee-4b9a-8a15-5559b086aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.720023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:41.757268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1024/2056] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:41.758965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435d63-217d-4b01-bef9-4981c91d71db None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.759257 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435d63-217d-4b01-bef9-4981c91d71db None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.759535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435d63-217d-4b01-bef9-4981c91d71db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.785868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1033/2057] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:41.786922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d723c19-faee-4b9a-8a15-5559b086aebc None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.789242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7d723c19-faee-4b9a-8a15-5559b086aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.800769 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-72435d63-217d-4b01-bef9-4981c91d71db None None] MFA Rules not processed for user `0c73ecfb02974ac9b704286a26ae14d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:41.801991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-72435d63-217d-4b01-bef9-4981c91d71db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.803078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d723c19-faee-4b9a-8a15-5559b086aebc None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.809382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.809926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.810202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.810473 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.811236 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.812924 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.824883 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1034/2058] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:41.825796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.827648 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.858905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af26e50-13e1-46b4-9153-97bc451e8fef admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.864713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d3172-13fb-4004-9583-7ddee5cf6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:41.864959 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d3172-13fb-4004-9583-7ddee5cf6e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.865226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d3172-13fb-4004-9583-7ddee5cf6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.865494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d3172-13fb-4004-9583-7ddee5cf6e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.866280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d3172-13fb-4004-9583-7ddee5cf6e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:41.868237 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d3172-13fb-4004-9583-7ddee5cf6e6b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:41.907652 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1035/2060] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:41.909095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc661-dee2-4532-80bb-0db072ac01c7 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:41.909591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc661-dee2-4532-80bb-0db072ac01c7 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:41.909787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc661-dee2-4532-80bb-0db072ac01c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:41.916247 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1025/2060] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:41.917290 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435d63-217d-4b01-bef9-4981c91d71db None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:41.928604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435d63-217d-4b01-bef9-4981c91d71db None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:41.935199 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-291bc661-dee2-4532-80bb-0db072ac01c7 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:41.936726 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-291bc661-dee2-4532-80bb-0db072ac01c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:41.942807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:42.041669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.042300 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.042585 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.042862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.043517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.045501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.056376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1036/2061] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:42.057001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc661-dee2-4532-80bb-0db072ac01c7 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.078783 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1026/2062] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:42.082453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc661-dee2-4532-80bb-0db072ac01c7 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.083328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.103643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:42.103889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d193-7807-4e18-8560-b7e05ef9daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.104557 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d193-7807-4e18-8560-b7e05ef9daf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.104956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d193-7807-4e18-8560-b7e05ef9daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.105390 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530d193-7807-4e18-8560-b7e05ef9daf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.106182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530d193-7807-4e18-8560-b7e05ef9daf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.123423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530d193-7807-4e18-8560-b7e05ef9daf4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.193006 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1037/2063] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:42 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:42.195849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d193-7807-4e18-8560-b7e05ef9daf4 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.216542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530d193-7807-4e18-8560-b7e05ef9daf4 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.223567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfb2c1-e374-4038-a4c5-1050fcffea67 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.231016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a153f-ea2d-4268-9873-c88840d7efc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.231641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a153f-ea2d-4268-9873-c88840d7efc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.231966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a153f-ea2d-4268-9873-c88840d7efc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.232245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a153f-ea2d-4268-9873-c88840d7efc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.232522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.233334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.233788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.234341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.235213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:42.235731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.237564 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.260745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1038/2064] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:42.260745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.270108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ee1d5-975a-42b1-8cb7-09cb68fe3d72 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.272794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=100 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:42.275202 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feeb7c-f745-44c5-900c-445ba283ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.276005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feeb7c-f745-44c5-900c-445ba283ef4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.276375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feeb7c-f745-44c5-900c-445ba283ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.276770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feeb7c-f745-44c5-900c-445ba283ef4c admin admin] PATH_INFO: `/v3/projects/917ab62e2f0e420d8c1f81d034d27de3/users/a18c7a64597242cc8c8e08582f06b305/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.295700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feeb7c-f745-44c5-900c-445ba283ef4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=917ab62e2f0e420d8c1f81d034d27de3, user_id=a18c7a64597242cc8c8e08582f06b305, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.299056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feeb7c-f745-44c5-900c-445ba283ef4c admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.339690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1039/2065] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:42 2022] PUT /identity/v3/projects/917ab62e2f0e420d8c1f81d034d27de3/users/a18c7a64597242cc8c8e08582f06b305/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:42.341054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a153f-ea2d-4268-9873-c88840d7efc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.341279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feeb7c-f745-44c5-900c-445ba283ef4c admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.342541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a153f-ea2d-4268-9873-c88840d7efc2 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.364760 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1027/2066] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:42.365648 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a153f-ea2d-4268-9873-c88840d7efc2 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.388498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a153f-ea2d-4268-9873-c88840d7efc2 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.492853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80929cfb-f27a-4f1d-8d07-655fb0a0bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.498888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80929cfb-f27a-4f1d-8d07-655fb0a0bdce admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.499253 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80929cfb-f27a-4f1d-8d07-655fb0a0bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.499628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80929cfb-f27a-4f1d-8d07-655fb0a0bdce admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.500517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80929cfb-f27a-4f1d-8d07-655fb0a0bdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.502654 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80929cfb-f27a-4f1d-8d07-655fb0a0bdce admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.529598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feeb7c-f745-44c5-900c-445ba283ef4c admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.543953 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1028/2067] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:42 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:42.545733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c501-675d-4f14-bbf1-1fdc84226541 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.546648 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c501-675d-4f14-bbf1-1fdc84226541 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.546999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c501-675d-4f14-bbf1-1fdc84226541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.549973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f355c5-40d5-4307-91e5-271ffe70a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.550721 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f355c5-40d5-4307-91e5-271ffe70a321 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.551005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f355c5-40d5-4307-91e5-271ffe70a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.551285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f355c5-40d5-4307-91e5-271ffe70a321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.551998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f355c5-40d5-4307-91e5-271ffe70a321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.554155 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f355c5-40d5-4307-91e5-271ffe70a321 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.571168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-5ba6c501-675d-4f14-bbf1-1fdc84226541 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:42.572683 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5ba6c501-675d-4f14-bbf1-1fdc84226541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:42.592703 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1040/2068] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:42.594221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f355c5-40d5-4307-91e5-271ffe70a321 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.605550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f355c5-40d5-4307-91e5-271ffe70a321 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.674452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:42.691593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.692700 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.693163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.694674 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] PATH_INFO: `/v3/users/4ad3c7587a99494a951498b552c05232` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.696507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad3c7587a99494a951498b552c05232)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.699027 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.712714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1029/2069] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:42.714567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6c501-675d-4f14-bbf1-1fdc84226541 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.726409 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6c501-675d-4f14-bbf1-1fdc84226541 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.732870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db202d4-afec-4cc8-ae8a-bdd666973403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.733497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db202d4-afec-4cc8-ae8a-bdd666973403 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.733778 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db202d4-afec-4cc8-ae8a-bdd666973403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.734060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db202d4-afec-4cc8-ae8a-bdd666973403 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.734998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db202d4-afec-4cc8-ae8a-bdd666973403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.737185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db202d4-afec-4cc8-ae8a-bdd666973403 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.765901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1030/2070] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:42 2022] POST /identity/v3/users => generated 284 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:42.767619 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db202d4-afec-4cc8-ae8a-bdd666973403 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.778516 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad3c7587a99494a951498b552c05232'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:42.786666 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad3c7587a99494a951498b552c05232'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:42.794187 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db202d4-afec-4cc8-ae8a-bdd666973403 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:42.800641 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad3c7587a99494a951498b552c05232'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:42.801696 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad3c7587a99494a951498b552c05232'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:42.805633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:42.807377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:42.809093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:42.809526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] PATH_INFO: `/v3/projects/24adcf2391204007afbe338d9ae661af/users/f6241de8e894410483461327e560ab7a/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:42.834136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad3c7587a99494a951498b552c05232'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:42.847734 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24adcf2391204007afbe338d9ae661af, user_id=f6241de8e894410483461327e560ab7a, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:42.852556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1041/2071] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:42 2022] DELETE /identity/v3/users/4ad3c7587a99494a951498b552c05232 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:42.853728 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.855731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:42.860615 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:42.875492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:42.885499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1031/2072] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:42 2022] PUT /identity/v3/projects/24adcf2391204007afbe338d9ae661af/users/f6241de8e894410483461327e560ab7a/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:42.886794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:42.889853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:42.956975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c77f5-aab5-4244-9806-eaac35b809c5 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.029493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.030126 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.030409 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.030687 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.032759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.040996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9daed5-d7b0-4a22-a226-7565331b659d admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.046547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd333f-0a7a-44b6-9dc8-2ebbd65e49a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.047186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd333f-0a7a-44b6-9dc8-2ebbd65e49a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.047474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd333f-0a7a-44b6-9dc8-2ebbd65e49a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.047891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd333f-0a7a-44b6-9dc8-2ebbd65e49a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.048584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd333f-0a7a-44b6-9dc8-2ebbd65e49a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.051284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd333f-0a7a-44b6-9dc8-2ebbd65e49a9 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.070784 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.071885 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1032/2073] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:43.072427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.073843 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e86a-e83b-4b2c-8580-f492c0426b36 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.076319 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e86a-e83b-4b2c-8580-f492c0426b36 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.079060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e86a-e83b-4b2c-8580-f492c0426b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.090049 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1042/2074] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:43.091023 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.092647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.100958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-2079e86a-e83b-4b2c-8580-f492c0426b36 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:43.102102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2079e86a-e83b-4b2c-8580-f492c0426b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.123398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1033/2075] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:43.123988 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3c90-932e-472a-93bc-0d90b18aba2f service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.124383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079e86a-e83b-4b2c-8580-f492c0426b36 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.148604 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079e86a-e83b-4b2c-8580-f492c0426b36 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.159193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac349-3adf-459d-a884-ec624aeb17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.160659 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac349-3adf-459d-a884-ec624aeb17b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.160962 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac349-3adf-459d-a884-ec624aeb17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.161256 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac349-3adf-459d-a884-ec624aeb17b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.164130 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9041e6-94c0-4c67-b658-bf4104435eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.164568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ac349-3adf-459d-a884-ec624aeb17b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.164784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9041e6-94c0-4c67-b658-bf4104435eed admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.165046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9041e6-94c0-4c67-b658-bf4104435eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.167439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9041e6-94c0-4c67-b658-bf4104435eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.169717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9041e6-94c0-4c67-b658-bf4104435eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.169952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ac349-3adf-459d-a884-ec624aeb17b2 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.174178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9041e6-94c0-4c67-b658-bf4104435eed admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.192424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1043/2076] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:43.193626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac349-3adf-459d-a884-ec624aeb17b2 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.195556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1034/2077] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:43.196504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9041e6-94c0-4c67-b658-bf4104435eed admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.208444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9041e6-94c0-4c67-b658-bf4104435eed admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.209532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac349-3adf-459d-a884-ec624aeb17b2 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.215689 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31222c-5269-4126-a62b-ee22371ad5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.216414 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31222c-5269-4126-a62b-ee22371ad5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.216694 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31222c-5269-4126-a62b-ee22371ad5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.216966 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31222c-5269-4126-a62b-ee22371ad5f0 admin admin] PATH_INFO: `/v3/projects/24adcf2391204007afbe338d9ae661af/users/f6241de8e894410483461327e560ab7a/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.219681 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6a881-4910-485d-bf86-70c927d040a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.220501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6a881-4910-485d-bf86-70c927d040a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.220873 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6a881-4910-485d-bf86-70c927d040a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.221626 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6a881-4910-485d-bf86-70c927d040a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.222522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31222c-5269-4126-a62b-ee22371ad5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24adcf2391204007afbe338d9ae661af, user_id=f6241de8e894410483461327e560ab7a, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.226102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31222c-5269-4126-a62b-ee22371ad5f0 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.240797 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6a881-4910-485d-bf86-70c927d040a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.245671 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6a881-4910-485d-bf86-70c927d040a3 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.249739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1035/2078] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:43 2022] PUT /identity/v3/projects/24adcf2391204007afbe338d9ae661af/users/f6241de8e894410483461327e560ab7a/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:43.250832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31222c-5269-4126-a62b-ee22371ad5f0 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.261472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1044/2079] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:43.263173 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e7d8-2db8-49c3-860f-79682798c543 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.263518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e7d8-2db8-49c3-860f-79682798c543 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.264096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e7d8-2db8-49c3-860f-79682798c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.278859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:43.299336 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-a5c8e7d8-2db8-49c3-860f-79682798c543 None None] MFA Rules not processed for user `f6241de8e894410483461327e560ab7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:43.300690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a5c8e7d8-2db8-49c3-860f-79682798c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.346188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31222c-5269-4126-a62b-ee22371ad5f0 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.354894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5339ab2-0ed2-4376-86c9-569699f76d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.356418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339ab2-0ed2-4376-86c9-569699f76d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.357035 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339ab2-0ed2-4376-86c9-569699f76d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.357474 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339ab2-0ed2-4376-86c9-569699f76d10 admin admin] PATH_INFO: `/v3/projects/83885d512d144caf9fd9f59d03ed5b48/users/ff62f7d9992040cf91a56c2b3ee15f3b/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.377643 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5339ab2-0ed2-4376-86c9-569699f76d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83885d512d144caf9fd9f59d03ed5b48, user_id=ff62f7d9992040cf91a56c2b3ee15f3b, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.381661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5339ab2-0ed2-4376-86c9-569699f76d10 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.398186 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1045/2080] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:43.410703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1036/2081] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:43 2022] PUT /identity/v3/projects/83885d512d144caf9fd9f59d03ed5b48/users/ff62f7d9992040cf91a56c2b3ee15f3b/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:43.413603 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8e7d8-2db8-49c3-860f-79682798c543 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.416866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a5c8e7d8-2db8-49c3-860f-79682798c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.427521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282352c3-986f-4496-9d31-1feca77d7fa3 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.427903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282352c3-986f-4496-9d31-1feca77d7fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.428175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282352c3-986f-4496-9d31-1feca77d7fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.478968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-282352c3-986f-4496-9d31-1feca77d7fa3 None None] MFA Rules not processed for user `ff62f7d9992040cf91a56c2b3ee15f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:43.480275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-282352c3-986f-4496-9d31-1feca77d7fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.524200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8e7d8-2db8-49c3-860f-79682798c543 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.570322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:43.590430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.591270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.591562 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.591990 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.593920 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:43.630232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1037/2082] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:43.635093 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282352c3-986f-4496-9d31-1feca77d7fa3 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.682019 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.683656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.697775 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1046/2083] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:43.753129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282352c3-986f-4496-9d31-1feca77d7fa3 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:43.764160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb158-9813-4f69-a1cc-ac8cdbc20936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:43.764801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb158-9813-4f69-a1cc-ac8cdbc20936 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:43.765087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb158-9813-4f69-a1cc-ac8cdbc20936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:43.765367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb158-9813-4f69-a1cc-ac8cdbc20936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:43.766000 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb158-9813-4f69-a1cc-ac8cdbc20936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:43.771513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb158-9813-4f69-a1cc-ac8cdbc20936 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:43.886551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1038/2084] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:43 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:43.890657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:43.897075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:43.907233 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c1f5b-1261-4ff5-a036-e7a06173c76a service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.052546 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c15d0-eb61-4565-83f2-2cffb72092a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.053226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c15d0-eb61-4565-83f2-2cffb72092a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.053605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c15d0-eb61-4565-83f2-2cffb72092a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.054443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c15d0-eb61-4565-83f2-2cffb72092a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.055099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c15d0-eb61-4565-83f2-2cffb72092a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.057738 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c15d0-eb61-4565-83f2-2cffb72092a2 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.088573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1047/2085] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:43 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:44.089879 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb158-9813-4f69-a1cc-ac8cdbc20936 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.103089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb158-9813-4f69-a1cc-ac8cdbc20936 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.110796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f2af1-c4c8-420f-8b3b-7da415244529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.112630 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f2af1-c4c8-420f-8b3b-7da415244529 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.113132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f2af1-c4c8-420f-8b3b-7da415244529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.113617 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f2af1-c4c8-420f-8b3b-7da415244529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.114528 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f2af1-c4c8-420f-8b3b-7da415244529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.118496 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f2af1-c4c8-420f-8b3b-7da415244529 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.145462 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1039/2086] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:44.149476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c15d0-eb61-4565-83f2-2cffb72092a2 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.161563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c15d0-eb61-4565-83f2-2cffb72092a2 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.168474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26361686-c1cd-419f-a98e-fa97b1787787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.170249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26361686-c1cd-419f-a98e-fa97b1787787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.170249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26361686-c1cd-419f-a98e-fa97b1787787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.170249 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26361686-c1cd-419f-a98e-fa97b1787787 admin admin] PATH_INFO: `/v3/projects/4bb7554dc405432082d5301648b1f1b6/users/f5ed8a3e9e6a48b5b5634891e0d95135/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.196001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26361686-c1cd-419f-a98e-fa97b1787787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb7554dc405432082d5301648b1f1b6, user_id=f5ed8a3e9e6a48b5b5634891e0d95135, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.196647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26361686-c1cd-419f-a98e-fa97b1787787 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.226547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1048/2087] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:44 2022] PUT /identity/v3/projects/4bb7554dc405432082d5301648b1f1b6/users/f5ed8a3e9e6a48b5b5634891e0d95135/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:44.230723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f2af1-c4c8-420f-8b3b-7da415244529 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.246451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f2af1-c4c8-420f-8b3b-7da415244529 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.374800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419f05b-dcf8-4dd0-a47b-2468c5ae311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.376037 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f05b-dcf8-4dd0-a47b-2468c5ae311b admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.379917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f05b-dcf8-4dd0-a47b-2468c5ae311b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.381377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419f05b-dcf8-4dd0-a47b-2468c5ae311b admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.382245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419f05b-dcf8-4dd0-a47b-2468c5ae311b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.384995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419f05b-dcf8-4dd0-a47b-2468c5ae311b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.418140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1040/2088] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:44.420996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26361686-c1cd-419f-a98e-fa97b1787787 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.440225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26361686-c1cd-419f-a98e-fa97b1787787 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.446136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.446856 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.447153 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.447433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] PATH_INFO: `/v3/projects/4bb7554dc405432082d5301648b1f1b6/users/f5ed8a3e9e6a48b5b5634891e0d95135/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.450162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb7554dc405432082d5301648b1f1b6, user_id=f5ed8a3e9e6a48b5b5634891e0d95135, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.453259 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.467113 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1049/2089] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:44 2022] PUT /identity/v3/projects/4bb7554dc405432082d5301648b1f1b6/users/f5ed8a3e9e6a48b5b5634891e0d95135/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:44.480276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89653c4-b489-46a4-b1f3-ea4c131dbf2b None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.480723 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89653c4-b489-46a4-b1f3-ea4c131dbf2b None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.480876 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89653c4-b489-46a4-b1f3-ea4c131dbf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.509454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.513372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.525234 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b89653c4-b489-46a4-b1f3-ea4c131dbf2b None None] MFA Rules not processed for user `f5ed8a3e9e6a48b5b5634891e0d95135`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:44.526961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b89653c4-b489-46a4-b1f3-ea4c131dbf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.569956 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:44.607392 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7ae35-f577-4c7f-b25d-893e617e1752 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.621131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.621707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.621984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.622255 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] PATH_INFO: `/v3/projects/8cdef92bfda143eab568e5bd009e558b` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.622853 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1041/2090] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:44.624276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9bfc-7b38-4394-99e5-ec93d605f146 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.624635 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9bfc-7b38-4394-99e5-ec93d605f146 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.625309 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c9bfc-7b38-4394-99e5-ec93d605f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.632889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdef92bfda143eab568e5bd009e558b)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.636232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.660502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b59c9bfc-7b38-4394-99e5-ec93d605f146 None None] MFA Rules not processed for user `a18c7a64597242cc8c8e08582f06b305`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:44.661847 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b59c9bfc-7b38-4394-99e5-ec93d605f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.693212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdef92bfda143eab568e5bd009e558b', 'request_id': 'req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.705450 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:44.707327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdef92bfda143eab568e5bd009e558b', 'request_id': 'req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.719448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdef92bfda143eab568e5bd009e558b', 'request_id': 'req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.732774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] The token cache is being invalidate because project 8cdef92bfda143eab568e5bd009e558b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:44.733169 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.733827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.735329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1050/2091] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:44 2022] DELETE /identity/v3/projects/8cdef92bfda143eab568e5bd009e558b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:44.735498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1042/2092] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:44.739106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.740518 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.746841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c9bfc-7b38-4394-99e5-ec93d605f146 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.758755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c9bfc-7b38-4394-99e5-ec93d605f146 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.817022 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2764d-a803-4c4b-afc9-c348ff70cb2b admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.821560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.822280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.822639 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.822950 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.824717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.828631 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.829271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.829549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.829964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] PATH_INFO: `/v3/users/0c73ecfb02974ac9b704286a26ae14d5` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.831015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c73ecfb02974ac9b704286a26ae14d5)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.833023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.884850 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c73ecfb02974ac9b704286a26ae14d5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.885547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c73ecfb02974ac9b704286a26ae14d5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.892623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c73ecfb02974ac9b704286a26ae14d5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.893289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c73ecfb02974ac9b704286a26ae14d5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.893818 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:44.895277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:44.902119 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c73ecfb02974ac9b704286a26ae14d5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:44.903460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:44.906925 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1051/2093] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:44.907745 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:44.909171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:44.920263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c421ab4-7280-43c2-8edb-6405be51fbf5 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:44.924104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:44.924584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1043/2094] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:44 2022] DELETE /identity/v3/users/0c73ecfb02974ac9b704286a26ae14d5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:44.924800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:44.925190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:44.925474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:44.927366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.014010 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.016647 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.017242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.018397 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.029206 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1052/2095] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:45.088942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a552c72-e5e6-462c-9537-24f6365e5e46 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.093586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ecfb-db73-41ef-8ebe-e0b37d9ab254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.094289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ecfb-db73-41ef-8ebe-e0b37d9ab254 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.094567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ecfb-db73-41ef-8ebe-e0b37d9ab254 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.094857 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ecfb-db73-41ef-8ebe-e0b37d9ab254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.097346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b152ecfb-db73-41ef-8ebe-e0b37d9ab254 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.171656 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ecfb-db73-41ef-8ebe-e0b37d9ab254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.173702 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ecfb-db73-41ef-8ebe-e0b37d9ab254 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.186748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1044/2096] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:45.214334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.217081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.235215 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf53a1-a666-4740-98d4-03542f519bc8 service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.272650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:45.311401 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.312254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.312838 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.313318 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] PATH_INFO: `/v3/projects/b1aaa689474c46269642cc52930b63e1` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.314956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1aaa689474c46269642cc52930b63e1)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.328338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.414423 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1aaa689474c46269642cc52930b63e1', 'request_id': 'req-e9acedff-1fe4-4a6f-80a9-7240383de4b5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.426542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1aaa689474c46269642cc52930b63e1', 'request_id': 'req-e9acedff-1fe4-4a6f-80a9-7240383de4b5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.442949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1aaa689474c46269642cc52930b63e1', 'request_id': 'req-e9acedff-1fe4-4a6f-80a9-7240383de4b5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.482953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] The token cache is being invalidate because project b1aaa689474c46269642cc52930b63e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:45.483509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.484435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-e9acedff-1fe4-4a6f-80a9-7240383de4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:45.486350 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1053/2097] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:45 2022] DELETE /identity/v3/projects/b1aaa689474c46269642cc52930b63e1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:45.491962 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3b80-753b-4d75-b6e7-76efa5e73872 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.492305 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3b80-753b-4d75-b6e7-76efa5e73872 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.492589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3b80-753b-4d75-b6e7-76efa5e73872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.524996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-423c3b80-753b-4d75-b6e7-76efa5e73872 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:45.527271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-423c3b80-753b-4d75-b6e7-76efa5e73872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.611753 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1045/2098] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:45.620480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c43c0-8fd5-4f1c-9ef5-d4cf5f377dfc None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.620772 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c43c0-8fd5-4f1c-9ef5-d4cf5f377dfc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.621057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c43c0-8fd5-4f1c-9ef5-d4cf5f377dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.654439 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-1c6c43c0-8fd5-4f1c-9ef5-d4cf5f377dfc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:45.655750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1c6c43c0-8fd5-4f1c-9ef5-d4cf5f377dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.668264 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1054/2099] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:45.669366 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3b80-753b-4d75-b6e7-76efa5e73872 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.687202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3b80-753b-4d75-b6e7-76efa5e73872 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.687202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.687202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.687439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.687548 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.688232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:45.688541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.690213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.702330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1046/2100] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:43:45.710992 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c43c0-8fd5-4f1c-9ef5-d4cf5f377dfc None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.719316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.721403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.721515 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c43c0-8fd5-4f1c-9ef5-d4cf5f377dfc None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.726830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf33d7-9462-4226-b11f-b473cca6a2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.727442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf33d7-9462-4226-b11f-b473cca6a2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.727720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf33d7-9462-4226-b11f-b473cca6a2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.728041 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf33d7-9462-4226-b11f-b473cca6a2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.728683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf33d7-9462-4226-b11f-b473cca6a2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.730579 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf33d7-9462-4226-b11f-b473cca6a2f3 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.750094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:45.761734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1055/2101] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:45.762932 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf33d7-9462-4226-b11f-b473cca6a2f3 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.784710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9af43b-ffdc-4ce9-b098-9b1e3d8e1b9f admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.828096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf33d7-9462-4226-b11f-b473cca6a2f3 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.832857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047d8f-8be6-4651-959e-17d6ff3a9118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.833463 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047d8f-8be6-4651-959e-17d6ff3a9118 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.833744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047d8f-8be6-4651-959e-17d6ff3a9118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.834017 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047d8f-8be6-4651-959e-17d6ff3a9118 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.835176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047d8f-8be6-4651-959e-17d6ff3a9118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.837147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047d8f-8be6-4651-959e-17d6ff3a9118 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.838560 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.839271 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.839596 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.839963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.842039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:45.858728 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1056/2102] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:45.862734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047d8f-8be6-4651-959e-17d6ff3a9118 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.872289 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047d8f-8be6-4651-959e-17d6ff3a9118 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.876968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d789e-a62c-4cfe-aaa9-2f693d5ff910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.877554 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d789e-a62c-4cfe-aaa9-2f693d5ff910 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.877837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d789e-a62c-4cfe-aaa9-2f693d5ff910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.878107 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d789e-a62c-4cfe-aaa9-2f693d5ff910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.878735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d789e-a62c-4cfe-aaa9-2f693d5ff910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.880404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d789e-a62c-4cfe-aaa9-2f693d5ff910 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.890593 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1057/2103] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:45.894301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d789e-a62c-4cfe-aaa9-2f693d5ff910 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.905882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d789e-a62c-4cfe-aaa9-2f693d5ff910 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.907848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.909302 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.910731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e26a4-7a67-46cc-8ab3-2c094de75133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.911324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e26a4-7a67-46cc-8ab3-2c094de75133 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.911607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e26a4-7a67-46cc-8ab3-2c094de75133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.911913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e26a4-7a67-46cc-8ab3-2c094de75133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.912581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e26a4-7a67-46cc-8ab3-2c094de75133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.914748 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e26a4-7a67-46cc-8ab3-2c094de75133 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.919566 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1047/2104] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:45.926456 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1058/2105] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:45.930883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:45.941577 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b54d4-0cb5-450f-9dc0-7b2568673157 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:45.946375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:45.947040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.947326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.947608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] PATH_INFO: `/v3/projects/28ef67703bc349acaeac8e314332348a/users/18b146f966a943f3bc1719ff9a37412b/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:45.971552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ef67703bc349acaeac8e314332348a, user_id=18b146f966a943f3bc1719ff9a37412b, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:45.974276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:45.987982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1048/2106] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:45 2022] PUT /identity/v3/projects/28ef67703bc349acaeac8e314332348a/users/18b146f966a943f3bc1719ff9a37412b/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:45.999225 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f446-91ac-49d8-bace-672ba9bbb3a7 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:45.999519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f446-91ac-49d8-bace-672ba9bbb3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:45.999845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7f446-91ac-49d8-bace-672ba9bbb3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:46.007544 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:46.050736 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-00e7f446-91ac-49d8-bace-672ba9bbb3a7 None None] MFA Rules not processed for user `18b146f966a943f3bc1719ff9a37412b`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:46.052003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-00e7f446-91ac-49d8-bace-672ba9bbb3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:46.120646 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1059/2107] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:46.133304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:46.135351 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:46.218210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:46.220819 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c4be8-9dd1-4313-8a6c-f34c4c00009f admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:46.225726 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3aac6-b914-4f57-9357-65df5fdbdcc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df1a3f053649456d982dd6c2d45d23c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:46.226582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3aac6-b914-4f57-9357-65df5fdbdcc1 service glance] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:46.227096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3aac6-b914-4f57-9357-65df5fdbdcc1 service glance] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:46.227397 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3aac6-b914-4f57-9357-65df5fdbdcc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:46.236074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3aac6-b914-4f57-9357-65df5fdbdcc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:46.237517 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3aac6-b914-4f57-9357-65df5fdbdcc1 service glance] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:46.246688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1049/2108] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:46.548067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09805e9-6236-4154-8b4b-e65eb8dd0f7c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:46.548358 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09805e9-6236-4154-8b4b-e65eb8dd0f7c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:46.548643 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09805e9-6236-4154-8b4b-e65eb8dd0f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:46.551885 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3aac6-b914-4f57-9357-65df5fdbdcc1 service glance] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:46.571987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-f09805e9-6236-4154-8b4b-e65eb8dd0f7c None None] MFA Rules not processed for user `a18c7a64597242cc8c8e08582f06b305`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:46.573078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f09805e9-6236-4154-8b4b-e65eb8dd0f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:46.625663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3aac6-b914-4f57-9357-65df5fdbdcc1 service glance] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:46.630315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d37d2-5427-4c39-9203-936bd0e91b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:46.632176 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d37d2-5427-4c39-9203-936bd0e91b25 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:46.632522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d37d2-5427-4c39-9203-936bd0e91b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:46.632840 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d37d2-5427-4c39-9203-936bd0e91b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:46.636223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8d1d37d2-5427-4c39-9203-936bd0e91b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:46.657125 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1060/2109] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:46.731039 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d37d2-5427-4c39-9203-936bd0e91b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:46.746444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d37d2-5427-4c39-9203-936bd0e91b25 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:46.788198 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1050/2110] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:50.280341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09805e9-6236-4154-8b4b-e65eb8dd0f7c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.282387 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-f09805e9-6236-4154-8b4b-e65eb8dd0f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.356170 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09805e9-6236-4154-8b4b-e65eb8dd0f7c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:50.360650 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:50.361280 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.361560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.361857 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] PATH_INFO: `/v3/users/ff62f7d9992040cf91a56c2b3ee15f3b` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.362967 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff62f7d9992040cf91a56c2b3ee15f3b)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:50.364937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:50.405004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:50.412334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff62f7d9992040cf91a56c2b3ee15f3b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.421948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff62f7d9992040cf91a56c2b3ee15f3b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.430074 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff62f7d9992040cf91a56c2b3ee15f3b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.430741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff62f7d9992040cf91a56c2b3ee15f3b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.443152 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff62f7d9992040cf91a56c2b3ee15f3b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.449026 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1061/2111] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:50 2022] DELETE /identity/v3/users/ff62f7d9992040cf91a56c2b3ee15f3b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:50.453710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332574-4e0d-4613-9009-d3588b95334a None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.454317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332574-4e0d-4613-9009-d3588b95334a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.454317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7332574-4e0d-4613-9009-d3588b95334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.473477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-b7332574-4e0d-4613-9009-d3588b95334a None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:50.474693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b7332574-4e0d-4613-9009-d3588b95334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.532288 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1051/2112] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:50.543861 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.546337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.603367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31524031-23ba-4b6d-8d69-39697d41e437 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:50.607134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856074b-8988-4a7c-8129-ef6ad50ca866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:50.607683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856074b-8988-4a7c-8129-ef6ad50ca866 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.607998 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856074b-8988-4a7c-8129-ef6ad50ca866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.608276 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856074b-8988-4a7c-8129-ef6ad50ca866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.617954 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856074b-8988-4a7c-8129-ef6ad50ca866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:50.619209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856074b-8988-4a7c-8129-ef6ad50ca866 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:50.629396 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1062/2113] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:50.727171 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7332574-4e0d-4613-9009-d3588b95334a None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.727410 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-b7332574-4e0d-4613-9009-d3588b95334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.739310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7332574-4e0d-4613-9009-d3588b95334a None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:50.744083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:50.744748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.745077 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.745333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] PATH_INFO: `/v3/users/c9fa6c10a7024096b7e9c53d821ddb8c` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.746457 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fa6c10a7024096b7e9c53d821ddb8c)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:50.748444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:50.788874 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:50.799022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fa6c10a7024096b7e9c53d821ddb8c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.799689 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fa6c10a7024096b7e9c53d821ddb8c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.806632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fa6c10a7024096b7e9c53d821ddb8c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.807277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fa6c10a7024096b7e9c53d821ddb8c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.814912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fa6c10a7024096b7e9c53d821ddb8c'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:50.843987 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1052/2114] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:50 2022] DELETE /identity/v3/users/c9fa6c10a7024096b7e9c53d821ddb8c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:50.848234 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cbf4c-1ced-44b4-affe-c27debb9d85d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.848528 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cbf4c-1ced-44b4-affe-c27debb9d85d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.848811 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cbf4c-1ced-44b4-affe-c27debb9d85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.868665 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-bf5cbf4c-1ced-44b4-affe-c27debb9d85d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:50.869801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bf5cbf4c-1ced-44b4-affe-c27debb9d85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.933069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1063/2115] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:50.945719 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.947692 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.969549 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cbf4c-1ced-44b4-affe-c27debb9d85d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:50.971056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-bf5cbf4c-1ced-44b4-affe-c27debb9d85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:50.984254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cbf4c-1ced-44b4-affe-c27debb9d85d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:50.989086 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:50.989754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:50.990429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:50.990429 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] PATH_INFO: `/v3/projects/83885d512d144caf9fd9f59d03ed5b48` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:50.992281 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83885d512d144caf9fd9f59d03ed5b48)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:50.994212 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.034752 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539a4fd-6d3f-4ea8-89b5-0fe6c012fd94 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.040861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ef19-ba20-44c8-b0d6-865afd508385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.042030 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ef19-ba20-44c8-b0d6-865afd508385 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.042348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ef19-ba20-44c8-b0d6-865afd508385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.042590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ef19-ba20-44c8-b0d6-865afd508385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.054834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744ef19-ba20-44c8-b0d6-865afd508385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.056314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744ef19-ba20-44c8-b0d6-865afd508385 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.058723 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83885d512d144caf9fd9f59d03ed5b48', 'request_id': 'req-a119dd4e-d9c6-45f6-878d-553dc19c022b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.063065 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:51.069213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83885d512d144caf9fd9f59d03ed5b48', 'request_id': 'req-a119dd4e-d9c6-45f6-878d-553dc19c022b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.077714 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1053/2116] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:51.089477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83885d512d144caf9fd9f59d03ed5b48', 'request_id': 'req-a119dd4e-d9c6-45f6-878d-553dc19c022b'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.101766 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] The token cache is being invalidate because project 83885d512d144caf9fd9f59d03ed5b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:51.102088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.102787 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.104663 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1064/2117] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:50 2022] DELETE /identity/v3/projects/83885d512d144caf9fd9f59d03ed5b48 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:51.108588 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ef19-ba20-44c8-b0d6-865afd508385 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:51.119120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ef19-ba20-44c8-b0d6-865afd508385 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.180063 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.180859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.181299 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.181440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] PATH_INFO: `/v3/users/f5ed8a3e9e6a48b5b5634891e0d95135` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.182572 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ed8a3e9e6a48b5b5634891e0d95135)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.184563 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.237404 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ed8a3e9e6a48b5b5634891e0d95135'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.238079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ed8a3e9e6a48b5b5634891e0d95135'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.252864 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ed8a3e9e6a48b5b5634891e0d95135'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.253841 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ed8a3e9e6a48b5b5634891e0d95135'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.258757 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:51.270610 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ed8a3e9e6a48b5b5634891e0d95135'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.290498 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1054/2118] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:51 2022] DELETE /identity/v3/users/f5ed8a3e9e6a48b5b5634891e0d95135 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:51.436618 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:51.439375 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.460362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119dd4e-d9c6-45f6-878d-553dc19c022b admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.537413 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.538210 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.539116 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.539455 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] PATH_INFO: `/v3/projects/cbf6e89e98724d2d81ae20aea11a8c75` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.540709 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf6e89e98724d2d81ae20aea11a8c75)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.542740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.597127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf6e89e98724d2d81ae20aea11a8c75', 'request_id': 'req-208b4f9d-a551-4c47-b583-480679ee8e14'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.603517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf6e89e98724d2d81ae20aea11a8c75', 'request_id': 'req-208b4f9d-a551-4c47-b583-480679ee8e14'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.611141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf6e89e98724d2d81ae20aea11a8c75', 'request_id': 'req-208b4f9d-a551-4c47-b583-480679ee8e14'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.626057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] The token cache is being invalidate because project cbf6e89e98724d2d81ae20aea11a8c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:51.626500 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.627156 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.632034 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1065/2119] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:51 2022] DELETE /identity/v3/projects/cbf6e89e98724d2d81ae20aea11a8c75 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:51.633636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:51.635325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.644800 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:51.646381 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.648910 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca134f-ee6c-4f4a-8eee-09a7a419ca2c admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.720915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4f9d-a551-4c47-b583-480679ee8e14 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:51.724115 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.724762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.725043 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.725318 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] PATH_INFO: `/v3/users/49819fc8619948779b72c46175028b75` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.725540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:51.726741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.727008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49819fc8619948779b72c46175028b75)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.727129 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.727283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] PATH_INFO: `/v3/projects/4bb7554dc405432082d5301648b1f1b6` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.728404 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb7554dc405432082d5301648b1f1b6)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:51.728985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.731448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:51.749538 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:51.789736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49819fc8619948779b72c46175028b75'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.790620 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49819fc8619948779b72c46175028b75'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.791551 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb7554dc405432082d5301648b1f1b6', 'request_id': 'req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.800085 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb7554dc405432082d5301648b1f1b6', 'request_id': 'req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.801541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49819fc8619948779b72c46175028b75'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.802273 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49819fc8619948779b72c46175028b75'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.809961 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb7554dc405432082d5301648b1f1b6', 'request_id': 'req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.813423 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-1aa2b39e-fe1d-413e-9007-d761bd534088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49819fc8619948779b72c46175028b75'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.822368 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] The token cache is being invalidate because project 4bb7554dc405432082d5301648b1f1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:51.822683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.823333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-68affa72-ac4e-4f22-ba86-bc258cf8a6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:51.825145 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1066/2120] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:51 2022] DELETE /identity/v3/projects/4bb7554dc405432082d5301648b1f1b6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:51.829530 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52897d-3ba4-4f9d-8bc6-c74f30934786 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.829822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52897d-3ba4-4f9d-8bc6-c74f30934786 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.830101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52897d-3ba4-4f9d-8bc6-c74f30934786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.836889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1055/2121] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:51 2022] DELETE /identity/v3/users/49819fc8619948779b72c46175028b75 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:51.858094 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-9e52897d-3ba4-4f9d-8bc6-c74f30934786 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:51.859288 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9e52897d-3ba4-4f9d-8bc6-c74f30934786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.931444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1067/2122] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:51.933258 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20febd40-80c7-4589-bbeb-51daafca1cba None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:51.933544 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20febd40-80c7-4589-bbeb-51daafca1cba None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:51.933821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20febd40-80c7-4589-bbeb-51daafca1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:51.966591 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-20febd40-80c7-4589-bbeb-51daafca1cba None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:51.967890 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-20febd40-80c7-4589-bbeb-51daafca1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:51.980316 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1056/2123] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:51.985088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52897d-3ba4-4f9d-8bc6-c74f30934786 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:51.996250 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52897d-3ba4-4f9d-8bc6-c74f30934786 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.001477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.002090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.002367 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.002638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.003341 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:52.004843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.006724 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.020529 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1068/2124] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:52.025195 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20febd40-80c7-4589-bbeb-51daafca1cba None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.037939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20febd40-80c7-4589-bbeb-51daafca1cba None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.043669 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ae9bb-4311-4c8d-8904-db071ba02fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.044552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae9bb-4311-4c8d-8904-db071ba02fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.044882 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae9bb-4311-4c8d-8904-db071ba02fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.045304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae9bb-4311-4c8d-8904-db071ba02fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.046009 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ae9bb-4311-4c8d-8904-db071ba02fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.051512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ae9bb-4311-4c8d-8904-db071ba02fd3 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.089590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1057/2125] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/projects => generated 361 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:52.093958 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.106242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11c2d8-aa63-4f8c-a973-c566d33edd4e admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.172589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.179446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.179446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.179446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.179446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.179446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.201542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1069/2126] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/users => generated 281 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:52.205307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ae9bb-4311-4c8d-8904-db071ba02fd3 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.221830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ae9bb-4311-4c8d-8904-db071ba02fd3 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.228026 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111e10-8fc0-4caa-a0da-9714850dabe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.228784 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111e10-8fc0-4caa-a0da-9714850dabe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.229074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111e10-8fc0-4caa-a0da-9714850dabe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.229406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111e10-8fc0-4caa-a0da-9714850dabe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.230060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111e10-8fc0-4caa-a0da-9714850dabe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.233400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111e10-8fc0-4caa-a0da-9714850dabe2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.234886 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.236995 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.243567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1058/2127] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:52.247436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111e10-8fc0-4caa-a0da-9714850dabe2 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.257684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5440e42-9441-40e2-a061-25eeb41c4035 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.259746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111e10-8fc0-4caa-a0da-9714850dabe2 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.263722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.264417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.264701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.264800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc88e-35e0-4274-b02a-5a85b6f57a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.265467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc88e-35e0-4274-b02a-5a85b6f57a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.265682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] PATH_INFO: `/v3/projects/04fbb8e062b2471e80b63127063c72e1` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.265812 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc88e-35e0-4274-b02a-5a85b6f57a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.266015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc88e-35e0-4274-b02a-5a85b6f57a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.266681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fc88e-35e0-4274-b02a-5a85b6f57a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.267203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fbb8e062b2471e80b63127063c72e1)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.268360 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fc88e-35e0-4274-b02a-5a85b6f57a80 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.270937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.282896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1059/2128] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:52.287402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc88e-35e0-4274-b02a-5a85b6f57a80 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.291960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:52.294794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:52.302218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc88e-35e0-4274-b02a-5a85b6f57a80 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.311535 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d69e2-970a-45a5-aedd-7cb905b0d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.312236 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d69e2-970a-45a5-aedd-7cb905b0d5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.312521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d69e2-970a-45a5-aedd-7cb905b0d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.312813 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d69e2-970a-45a5-aedd-7cb905b0d5db admin admin] PATH_INFO: `/v3/projects/1c435e27028d4ebabaff5762c032a695/users/1411ec1034bc41bcb44cef2cc6f323fc/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.332787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d69e2-970a-45a5-aedd-7cb905b0d5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c435e27028d4ebabaff5762c032a695, user_id=1411ec1034bc41bcb44cef2cc6f323fc, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.339848 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d69e2-970a-45a5-aedd-7cb905b0d5db admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.344596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fbb8e062b2471e80b63127063c72e1', 'request_id': 'req-7db567a1-735a-4ebc-9713-93bd24c7f3ec'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.352636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1060/2129] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:52 2022] PUT /identity/v3/projects/1c435e27028d4ebabaff5762c032a695/users/1411ec1034bc41bcb44cef2cc6f323fc/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:52.353314 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fbb8e062b2471e80b63127063c72e1', 'request_id': 'req-7db567a1-735a-4ebc-9713-93bd24c7f3ec'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.362517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fbb8e062b2471e80b63127063c72e1', 'request_id': 'req-7db567a1-735a-4ebc-9713-93bd24c7f3ec'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.364045 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487108c8-f051-4b38-935d-eff3aa9815d3 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.365440 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487108c8-f051-4b38-935d-eff3aa9815d3 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.365804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487108c8-f051-4b38-935d-eff3aa9815d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.376419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] The token cache is being invalidate because project 04fbb8e062b2471e80b63127063c72e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:52.376631 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.382862 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.390471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1070/2130] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:52 2022] DELETE /identity/v3/projects/04fbb8e062b2471e80b63127063c72e1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:52.392272 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.394097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.408846 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-487108c8-f051-4b38-935d-eff3aa9815d3 None None] MFA Rules not processed for user `1411ec1034bc41bcb44cef2cc6f323fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:52.410484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-487108c8-f051-4b38-935d-eff3aa9815d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.479362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db567a1-735a-4ebc-9713-93bd24c7f3ec admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.490332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1061/2131] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:52.540901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487108c8-f051-4b38-935d-eff3aa9815d3 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.542735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-487108c8-f051-4b38-935d-eff3aa9815d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.563285 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.564510 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.564795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.565099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] PATH_INFO: `/v3/users/f6241de8e894410483461327e560ab7a` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.566345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6241de8e894410483461327e560ab7a)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.569176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.618471 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487108c8-f051-4b38-935d-eff3aa9815d3 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.625796 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.627516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.627988 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.628263 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.639559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.641174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.651140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6241de8e894410483461327e560ab7a'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.652294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1062/2132] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:43:52.657911 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:52.661433 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6241de8e894410483461327e560ab7a'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.675114 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.677051 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.682669 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6241de8e894410483461327e560ab7a'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.683553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6241de8e894410483461327e560ab7a'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.698969 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-b7a7cdc3-e84a-4ed5-9ac7-ac3f0ee7bdc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6241de8e894410483461327e560ab7a'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.699705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3d18-825d-4d6b-9e3b-2a6427248514 service cinder] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:52.705212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:52.705859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.706138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.706411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] PATH_INFO: `/v3/users/1411ec1034bc41bcb44cef2cc6f323fc` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.707279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1071/2133] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:52 2022] DELETE /identity/v3/users/f6241de8e894410483461327e560ab7a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:52.707733 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1411ec1034bc41bcb44cef2cc6f323fc)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:52.709806 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:52.771321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1411ec1034bc41bcb44cef2cc6f323fc'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.772228 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1411ec1034bc41bcb44cef2cc6f323fc'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.783511 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1411ec1034bc41bcb44cef2cc6f323fc'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.785218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1411ec1034bc41bcb44cef2cc6f323fc'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.799632 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1411ec1034bc41bcb44cef2cc6f323fc'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:52.806402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:52.837697 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1063/2134] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:52 2022] DELETE /identity/v3/users/1411ec1034bc41bcb44cef2cc6f323fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:52.842159 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6b03e-f7c6-455c-8d5e-b64479eef3dc None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:52.842444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6b03e-f7c6-455c-8d5e-b64479eef3dc None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:52.842716 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6b03e-f7c6-455c-8d5e-b64479eef3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:52.864850 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-6ca6b03e-f7c6-455c-8d5e-b64479eef3dc None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:52.866785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6ca6b03e-f7c6-455c-8d5e-b64479eef3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:52.956991 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1072/2135] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:52.968028 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:52.969467 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.033352 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bfafe-bd94-468b-80c8-a1c79b2d87f4 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.037374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.038084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.038434 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.038776 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.049938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.051468 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.061804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1064/2136] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:53.360496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6b03e-f7c6-455c-8d5e-b64479eef3dc None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.361933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-6ca6b03e-f7c6-455c-8d5e-b64479eef3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.382295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6b03e-f7c6-455c-8d5e-b64479eef3dc None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.388322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.388996 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.389310 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.389614 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] PATH_INFO: `/v3/projects/1c435e27028d4ebabaff5762c032a695` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.390940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c435e27028d4ebabaff5762c032a695)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.393167 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.438684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.441025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.455808 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c435e27028d4ebabaff5762c032a695', 'request_id': 'req-02cbc091-a81c-4764-adeb-8e58d6689171'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.461176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c435e27028d4ebabaff5762c032a695', 'request_id': 'req-02cbc091-a81c-4764-adeb-8e58d6689171'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.470739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96c563-4565-43de-bcfb-cd180bed9a9a service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.473788 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c435e27028d4ebabaff5762c032a695', 'request_id': 'req-02cbc091-a81c-4764-adeb-8e58d6689171'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.487697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] The token cache is being invalidate because project 1c435e27028d4ebabaff5762c032a695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:53.488379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.488955 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-02cbc091-a81c-4764-adeb-8e58d6689171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.492713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1073/2137] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:53 2022] DELETE /identity/v3/projects/1c435e27028d4ebabaff5762c032a695 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:53.495597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba765b2-340f-49fd-b33f-f3cc844c4d4d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.495913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba765b2-340f-49fd-b33f-f3cc844c4d4d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.496227 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba765b2-340f-49fd-b33f-f3cc844c4d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.518200 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-aba765b2-340f-49fd-b33f-f3cc844c4d4d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:53.519487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-aba765b2-340f-49fd-b33f-f3cc844c4d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.571793 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.572600 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.573032 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.573315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] PATH_INFO: `/v3/projects/24adcf2391204007afbe338d9ae661af` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.578342 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24adcf2391204007afbe338d9ae661af)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.580383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.584732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:53.605725 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1074/2138] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:53.613871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1e045-6a5b-4526-81d8-d767e2e76931 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.614226 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1e045-6a5b-4526-81d8-d767e2e76931 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.614573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1e045-6a5b-4526-81d8-d767e2e76931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.653605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-a1c1e045-6a5b-4526-81d8-d767e2e76931 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:53.655364 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a1c1e045-6a5b-4526-81d8-d767e2e76931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.660097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24adcf2391204007afbe338d9ae661af', 'request_id': 'req-db3766ae-a973-4c5c-914f-a0a216369988'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.673598 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24adcf2391204007afbe338d9ae661af', 'request_id': 'req-db3766ae-a973-4c5c-914f-a0a216369988'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.687799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24adcf2391204007afbe338d9ae661af', 'request_id': 'req-db3766ae-a973-4c5c-914f-a0a216369988'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.703522 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] The token cache is being invalidate because project 24adcf2391204007afbe338d9ae661af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:53.703984 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.704731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-db3766ae-a973-4c5c-914f-a0a216369988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:53.707070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1065/2139] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:53 2022] DELETE /identity/v3/projects/24adcf2391204007afbe338d9ae661af => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:53.713165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe494595-0479-47ec-adc2-c06299b2a591 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.713523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe494595-0479-47ec-adc2-c06299b2a591 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.714089 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe494595-0479-47ec-adc2-c06299b2a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.738507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-fe494595-0479-47ec-adc2-c06299b2a591 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:53.740140 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-fe494595-0479-47ec-adc2-c06299b2a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.746859 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1075/2140] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:53.750994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1e045-6a5b-4526-81d8-d767e2e76931 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.760448 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1066/2141] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:53.761878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1e045-6a5b-4526-81d8-d767e2e76931 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.767374 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.768296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.768651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.769004 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.769242 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7024ca3-7b67-42e7-8f97-83e9cdf2e9f7 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.769527 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7024ca3-7b67-42e7-8f97-83e9cdf2e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.769909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:53.770015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7024ca3-7b67-42e7-8f97-83e9cdf2e9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.770352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.772207 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.790432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1076/2142] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:43:53.790739 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-e7024ca3-7b67-42e7-8f97-83e9cdf2e9f7 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:53.791371 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.792025 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-e7024ca3-7b67-42e7-8f97-83e9cdf2e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:53.803499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1067/2143] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:53.803704 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74509fd6-0a11-41a4-b2d2-55a5e6f62ce6 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.804558 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7024ca3-7b67-42e7-8f97-83e9cdf2e9f7 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.807078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146077-f718-4663-8315-fa4fd6057e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.807762 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146077-f718-4663-8315-fa4fd6057e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.808190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146077-f718-4663-8315-fa4fd6057e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.808540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146077-f718-4663-8315-fa4fd6057e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.809250 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146077-f718-4663-8315-fa4fd6057e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.811246 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d146077-f718-4663-8315-fa4fd6057e5f admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.811616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:53.816227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7024ca3-7b67-42e7-8f97-83e9cdf2e9f7 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.828932 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.829907 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.830549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.831017 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.831995 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:43:53.833178 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.837416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.852704 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1068/2144] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:43:53.858094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.869835 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0dbb8c-4027-4f29-86eb-3435c0cb1cac admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.872003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1077/2145] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:53.875956 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146077-f718-4663-8315-fa4fd6057e5f admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:53.951002 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef198c-cf75-4e83-aeeb-feb900e414bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.951625 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef198c-cf75-4e83-aeeb-feb900e414bb admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.951961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef198c-cf75-4e83-aeeb-feb900e414bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.952236 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef198c-cf75-4e83-aeeb-feb900e414bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.952980 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef198c-cf75-4e83-aeeb-feb900e414bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.954496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146077-f718-4663-8315-fa4fd6057e5f admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:53.955042 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef198c-cf75-4e83-aeeb-feb900e414bb admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:53.973481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f764-70e0-4c3a-aa58-45e1a753bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:53.973876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f764-70e0-4c3a-aa58-45e1a753bea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:53.974101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f764-70e0-4c3a-aa58-45e1a753bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:53.974378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f764-70e0-4c3a-aa58-45e1a753bea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:53.975032 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149f764-70e0-4c3a-aa58-45e1a753bea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:53.977064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149f764-70e0-4c3a-aa58-45e1a753bea7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.001935 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1078/2146] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:54.003224 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1069/2147] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:53 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:54.003740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f764-70e0-4c3a-aa58-45e1a753bea7 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.008761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef198c-cf75-4e83-aeeb-feb900e414bb admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.015565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f764-70e0-4c3a-aa58-45e1a753bea7 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.104638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:54.138148 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35942e6-5e82-4313-986a-93200423da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.138928 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35942e6-5e82-4313-986a-93200423da3a admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.139345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35942e6-5e82-4313-986a-93200423da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.139697 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35942e6-5e82-4313-986a-93200423da3a admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.140710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35942e6-5e82-4313-986a-93200423da3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.142523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef198c-cf75-4e83-aeeb-feb900e414bb admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.143822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35942e6-5e82-4313-986a-93200423da3a admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.156478 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d19e0-b131-46b0-ba6a-65b13731ed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.157117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d19e0-b131-46b0-ba6a-65b13731ed2e admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.157500 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d19e0-b131-46b0-ba6a-65b13731ed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.157781 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d19e0-b131-46b0-ba6a-65b13731ed2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.158537 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d19e0-b131-46b0-ba6a-65b13731ed2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.160834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d19e0-b131-46b0-ba6a-65b13731ed2e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.178691 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1070/2148] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:54.180891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d19e0-b131-46b0-ba6a-65b13731ed2e admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.192509 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1079/2149] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:54 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:43:54.196682 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35942e6-5e82-4313-986a-93200423da3a admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.202774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d19e0-b131-46b0-ba6a-65b13731ed2e admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.222771 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35942e6-5e82-4313-986a-93200423da3a admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.223832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820c6f-bb65-4f26-a713-6a9da0b4890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.224513 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820c6f-bb65-4f26-a713-6a9da0b4890b admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.224833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820c6f-bb65-4f26-a713-6a9da0b4890b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.225230 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820c6f-bb65-4f26-a713-6a9da0b4890b admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.226458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2820c6f-bb65-4f26-a713-6a9da0b4890b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.230799 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2820c6f-bb65-4f26-a713-6a9da0b4890b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.234144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a077d4-b38a-424b-bcc4-c6784beed60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.234929 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a077d4-b38a-424b-bcc4-c6784beed60d admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.235216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a077d4-b38a-424b-bcc4-c6784beed60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.235494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a077d4-b38a-424b-bcc4-c6784beed60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.236228 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a077d4-b38a-424b-bcc4-c6784beed60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.240098 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a077d4-b38a-424b-bcc4-c6784beed60d admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.254974 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1071/2150] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:54.256191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820c6f-bb65-4f26-a713-6a9da0b4890b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.277160 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820c6f-bb65-4f26-a713-6a9da0b4890b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.283323 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7f68-8d0e-47d5-b10e-4c3eedc202cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.284138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7f68-8d0e-47d5-b10e-4c3eedc202cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.284507 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7f68-8d0e-47d5-b10e-4c3eedc202cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.285173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7f68-8d0e-47d5-b10e-4c3eedc202cc admin admin] PATH_INFO: `/v3/projects/2d6347282ca345b98bdeb6c1936ccdd4/users/5164a9cbb5a04310a332852f91e964b5/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.303301 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1080/2151] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:54.306878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a077d4-b38a-424b-bcc4-c6784beed60d admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.334497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf7f68-8d0e-47d5-b10e-4c3eedc202cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6347282ca345b98bdeb6c1936ccdd4, user_id=5164a9cbb5a04310a332852f91e964b5, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.339641 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf7f68-8d0e-47d5-b10e-4c3eedc202cc admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.344805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a077d4-b38a-424b-bcc4-c6784beed60d admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.356540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b997b98-57d8-49f5-8ba2-5516dd4fafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.361947 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997b98-57d8-49f5-8ba2-5516dd4fafca admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.363048 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997b98-57d8-49f5-8ba2-5516dd4fafca admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.363335 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997b98-57d8-49f5-8ba2-5516dd4fafca admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.365763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b997b98-57d8-49f5-8ba2-5516dd4fafca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.369109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1072/2152] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:54 2022] PUT /identity/v3/projects/2d6347282ca345b98bdeb6c1936ccdd4/users/5164a9cbb5a04310a332852f91e964b5/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:54.381823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96801-3118-459b-905f-54d2307372f3 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.382683 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b997b98-57d8-49f5-8ba2-5516dd4fafca admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.384534 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96801-3118-459b-905f-54d2307372f3 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.384680 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b96801-3118-459b-905f-54d2307372f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.409127 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1081/2153] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:43:54.410374 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b997b98-57d8-49f5-8ba2-5516dd4fafca admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.430061 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b997b98-57d8-49f5-8ba2-5516dd4fafca admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.433862 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-46b96801-3118-459b-905f-54d2307372f3 None None] MFA Rules not processed for user `5164a9cbb5a04310a332852f91e964b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:54.436199 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-46b96801-3118-459b-905f-54d2307372f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:54.471362 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:54.512458 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e48250-dac1-48c1-88b1-1635fa9a4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.513140 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48250-dac1-48c1-88b1-1635fa9a4e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.513431 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48250-dac1-48c1-88b1-1635fa9a4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.513711 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e48250-dac1-48c1-88b1-1635fa9a4e90 admin admin] PATH_INFO: `/v3/projects/23755ee031ec4013ae1888584d269434/users/81f56b0d6ef84f32a0140cae67d46a3f/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.522215 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1073/2154] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:54.527142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b96801-3118-459b-905f-54d2307372f3 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.531821 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e48250-dac1-48c1-88b1-1635fa9a4e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23755ee031ec4013ae1888584d269434, user_id=81f56b0d6ef84f32a0140cae67d46a3f, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.535496 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e48250-dac1-48c1-88b1-1635fa9a4e90 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.538867 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b96801-3118-459b-905f-54d2307372f3 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.545001 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39ba7d-c298-4c4b-aae8-ced6e4cfdb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.545645 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ba7d-c298-4c4b-aae8-ced6e4cfdb58 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.545921 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ba7d-c298-4c4b-aae8-ced6e4cfdb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.546189 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ba7d-c298-4c4b-aae8-ced6e4cfdb58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.547168 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39ba7d-c298-4c4b-aae8-ced6e4cfdb58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.548789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39ba7d-c298-4c4b-aae8-ced6e4cfdb58 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.552442 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1082/2155] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:54 2022] PUT /identity/v3/projects/23755ee031ec4013ae1888584d269434/users/81f56b0d6ef84f32a0140cae67d46a3f/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:54.576480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13450d-06d4-4b84-ba27-071408fa5f72 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.576673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13450d-06d4-4b84-ba27-071408fa5f72 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.576978 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13450d-06d4-4b84-ba27-071408fa5f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.581855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1074/2156] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:43:54 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:54.587815 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39ba7d-c298-4c4b-aae8-ced6e4cfdb58 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.612453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-9c13450d-06d4-4b84-ba27-071408fa5f72 None None] MFA Rules not processed for user `81f56b0d6ef84f32a0140cae67d46a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:54.621623 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9c13450d-06d4-4b84-ba27-071408fa5f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:54.680472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39ba7d-c298-4c4b-aae8-ced6e4cfdb58 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.688354 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fce376-011d-4a9c-bc7f-6b30cdd0cdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.689109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce376-011d-4a9c-bc7f-6b30cdd0cdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.689399 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce376-011d-4a9c-bc7f-6b30cdd0cdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.689718 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce376-011d-4a9c-bc7f-6b30cdd0cdd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.690373 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fce376-011d-4a9c-bc7f-6b30cdd0cdd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.693144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fce376-011d-4a9c-bc7f-6b30cdd0cdd5 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.720328 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1083/2157] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:54.731238 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1075/2158] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:43:54 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:43:54.734547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13450d-06d4-4b84-ba27-071408fa5f72 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.736266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9c13450d-06d4-4b84-ba27-071408fa5f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:54.736470 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fce376-011d-4a9c-bc7f-6b30cdd0cdd5 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.748273 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fce376-011d-4a9c-bc7f-6b30cdd0cdd5 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.753454 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae749e29-b40f-4ab7-a1b4-c7c9fa3def06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.754329 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749e29-b40f-4ab7-a1b4-c7c9fa3def06 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.754787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749e29-b40f-4ab7-a1b4-c7c9fa3def06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.755265 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae749e29-b40f-4ab7-a1b4-c7c9fa3def06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.756501 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae749e29-b40f-4ab7-a1b4-c7c9fa3def06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.758695 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae749e29-b40f-4ab7-a1b4-c7c9fa3def06 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.771706 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1076/2159] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:54.775109 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae749e29-b40f-4ab7-a1b4-c7c9fa3def06 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.786861 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae749e29-b40f-4ab7-a1b4-c7c9fa3def06 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.792886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ab1c2-cb6a-42fb-aad2-3c6ba092862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.793703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ab1c2-cb6a-42fb-aad2-3c6ba092862d admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.794040 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ab1c2-cb6a-42fb-aad2-3c6ba092862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.794400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ab1c2-cb6a-42fb-aad2-3c6ba092862d admin admin] PATH_INFO: `/v3/projects/8e0229b9bf0c427f87cd64b36ef81668/users/26d19ac89cbb48ad8d1d1af967b798b5/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.798976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:54.817131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ab1c2-cb6a-42fb-aad2-3c6ba092862d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0229b9bf0c427f87cd64b36ef81668, user_id=26d19ac89cbb48ad8d1d1af967b798b5, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.822367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ab1c2-cb6a-42fb-aad2-3c6ba092862d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.840062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1077/2160] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:54 2022] PUT /identity/v3/projects/8e0229b9bf0c427f87cd64b36ef81668/users/26d19ac89cbb48ad8d1d1af967b798b5/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:54.852291 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ab1c2-cb6a-42fb-aad2-3c6ba092862d admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:54.865459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13450d-06d4-4b84-ba27-071408fa5f72 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.926029 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad100-1e04-40b5-847c-e2d9af1d2665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.926759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad100-1e04-40b5-847c-e2d9af1d2665 service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.927043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad100-1e04-40b5-847c-e2d9af1d2665 service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.927313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad100-1e04-40b5-847c-e2d9af1d2665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.977403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ab1c2-cb6a-42fb-aad2-3c6ba092862d admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:54.982559 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164fad7-242a-4852-b2ab-9e98e4c795e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:54.983174 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164fad7-242a-4852-b2ab-9e98e4c795e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:54.983452 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164fad7-242a-4852-b2ab-9e98e4c795e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:54.983725 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164fad7-242a-4852-b2ab-9e98e4c795e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:54.984424 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164fad7-242a-4852-b2ab-9e98e4c795e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:54.986034 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164fad7-242a-4852-b2ab-9e98e4c795e4 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:54.987866 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:54.998707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbad100-1e04-40b5-847c-e2d9af1d2665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.000334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbad100-1e04-40b5-847c-e2d9af1d2665 service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:55.000466 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1078/2161] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:43:55.004801 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164fad7-242a-4852-b2ab-9e98e4c795e4 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:55.011239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1084/2162] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:55.019237 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164fad7-242a-4852-b2ab-9e98e4c795e4 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:55.026108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:55.026803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.027209 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.027703 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] PATH_INFO: `/v3/projects/8e0229b9bf0c427f87cd64b36ef81668/users/26d19ac89cbb48ad8d1d1af967b798b5/roles/32319452053845419798d329f1c194d4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.029674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0229b9bf0c427f87cd64b36ef81668, user_id=26d19ac89cbb48ad8d1d1af967b798b5, role_id=32319452053845419798d329f1c194d4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.032484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:55.043956 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1079/2163] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:43:55 2022] PUT /identity/v3/projects/8e0229b9bf0c427f87cd64b36ef81668/users/26d19ac89cbb48ad8d1d1af967b798b5/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:55.055827 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1207-9738-46cf-b0e7-980d5c09cab3 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.056667 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1207-9738-46cf-b0e7-980d5c09cab3 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.057182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1207-9738-46cf-b0e7-980d5c09cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.100365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-fe1c1207-9738-46cf-b0e7-980d5c09cab3 None None] MFA Rules not processed for user `26d19ac89cbb48ad8d1d1af967b798b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:55.101734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-fe1c1207-9738-46cf-b0e7-980d5c09cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:55.223104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1085/2164] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:55.238335 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:55.244553 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:55.342065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74f6fa-03c2-4881-9deb-dc032fc33e59 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:55.346808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc454e1-580a-4cde-a953-2bd78ee068c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:55.347492 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc454e1-580a-4cde-a953-2bd78ee068c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:55.347849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc454e1-580a-4cde-a953-2bd78ee068c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:55.348108 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc454e1-580a-4cde-a953-2bd78ee068c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:55.423268 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc454e1-580a-4cde-a953-2bd78ee068c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:55.425031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc454e1-580a-4cde-a953-2bd78ee068c0 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:55.438096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1080/2165] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:57.702780 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1207-9738-46cf-b0e7-980d5c09cab3 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:57.739533 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:57.779540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1207-9738-46cf-b0e7-980d5c09cab3 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:57.784860 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:57.785927 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:57.786306 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:57.786693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] PATH_INFO: `/v3/users/81f56b0d6ef84f32a0140cae67d46a3f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:57.788073 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f56b0d6ef84f32a0140cae67d46a3f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:57.792722 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:57.851939 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f56b0d6ef84f32a0140cae67d46a3f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:57.859446 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f56b0d6ef84f32a0140cae67d46a3f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:57.867672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f56b0d6ef84f32a0140cae67d46a3f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:57.868324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f56b0d6ef84f32a0140cae67d46a3f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:57.890007 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f56b0d6ef84f32a0140cae67d46a3f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:57.892114 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1086/2166] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:57 2022] DELETE /identity/v3/users/81f56b0d6ef84f32a0140cae67d46a3f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:57.896800 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f141-6c9b-4fd0-b008-fe31c6fcef19 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:57.897328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f141-6c9b-4fd0-b008-fe31c6fcef19 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:57.897328 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7f141-6c9b-4fd0-b008-fe31c6fcef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:57.918521 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ebd7f141-6c9b-4fd0-b008-fe31c6fcef19 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:57.919745 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ebd7f141-6c9b-4fd0-b008-fe31c6fcef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:57.981217 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1081/2167] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:57.991090 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:57.992672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.033730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7f141-6c9b-4fd0-b008-fe31c6fcef19 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.035731 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ebd7f141-6c9b-4fd0-b008-fe31c6fcef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.051479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7f141-6c9b-4fd0-b008-fe31c6fcef19 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.056573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.057207 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.057484 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.057754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] PATH_INFO: `/v3/users/5164a9cbb5a04310a332852f91e964b5` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.058888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5164a9cbb5a04310a332852f91e964b5)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.061269 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.069527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17002a49-b35b-4fe8-8dad-bffbff2e02ce admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.073421 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbe7a3-7841-43d8-a919-fb8a5464543a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.074037 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe7a3-7841-43d8-a919-fb8a5464543a service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.074320 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe7a3-7841-43d8-a919-fb8a5464543a service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.074602 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe7a3-7841-43d8-a919-fb8a5464543a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.084807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbe7a3-7841-43d8-a919-fb8a5464543a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.087163 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbe7a3-7841-43d8-a919-fb8a5464543a service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.099595 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1087/2168] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:58.105902 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:58.141744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5164a9cbb5a04310a332852f91e964b5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.142546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5164a9cbb5a04310a332852f91e964b5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.153717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5164a9cbb5a04310a332852f91e964b5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.154684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5164a9cbb5a04310a332852f91e964b5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.165472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5164a9cbb5a04310a332852f91e964b5'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.197946 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1082/2169] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:58 2022] DELETE /identity/v3/users/5164a9cbb5a04310a332852f91e964b5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:43:58.202454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921423d-ad53-403a-a9ff-7937c9e23df8 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.202855 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921423d-ad53-403a-a9ff-7937c9e23df8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.204466 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921423d-ad53-403a-a9ff-7937c9e23df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.240840 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3921423d-ad53-403a-a9ff-7937c9e23df8 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:58.242188 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3921423d-ad53-403a-a9ff-7937c9e23df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.301952 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:58.332688 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1088/2170] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:58.346735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.348191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.426606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9088b-61a8-49e8-8170-9f3138c3bb7e admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.432124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921423d-ad53-403a-a9ff-7937c9e23df8 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.433296 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.433762 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3921423d-ad53-403a-a9ff-7937c9e23df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.434555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.434834 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.435104 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.446830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.448250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.455101 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921423d-ad53-403a-a9ff-7937c9e23df8 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.460934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1083/2171] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:43:58.462993 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.463645 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.463987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.464260 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] PATH_INFO: `/v3/projects/23755ee031ec4013ae1888584d269434` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.465501 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=23755ee031ec4013ae1888584d269434)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.467566 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:58.546896 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23755ee031ec4013ae1888584d269434', 'request_id': 'req-2a43e68a-04c6-45b5-81d3-113242f3aa6f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.555754 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23755ee031ec4013ae1888584d269434', 'request_id': 'req-2a43e68a-04c6-45b5-81d3-113242f3aa6f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.573949 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23755ee031ec4013ae1888584d269434', 'request_id': 'req-2a43e68a-04c6-45b5-81d3-113242f3aa6f'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.587124 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] The token cache is being invalidate because project 23755ee031ec4013ae1888584d269434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:58.587504 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.588300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:58.590223 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1089/2172] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:58 2022] DELETE /identity/v3/projects/23755ee031ec4013ae1888584d269434 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:58.817407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:58.818852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:58.833172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c4e17-62c3-4fa1-b928-e48fb8752ef7 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:58.933185 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:58.933893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:58.934127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:58.934698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] PATH_INFO: `/v3/projects/2d6347282ca345b98bdeb6c1936ccdd4` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:58.935936 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6347282ca345b98bdeb6c1936ccdd4)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:58.937896 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:59.021101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6347282ca345b98bdeb6c1936ccdd4', 'request_id': 'req-83f77418-575b-4926-8b90-890f57eb8dc6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.029423 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6347282ca345b98bdeb6c1936ccdd4', 'request_id': 'req-83f77418-575b-4926-8b90-890f57eb8dc6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.031730 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:59.041710 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6347282ca345b98bdeb6c1936ccdd4', 'request_id': 'req-83f77418-575b-4926-8b90-890f57eb8dc6'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.063978 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] The token cache is being invalidate because project 2d6347282ca345b98bdeb6c1936ccdd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:59.064375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.065146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.067554 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1084/2173] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:58 2022] DELETE /identity/v3/projects/2d6347282ca345b98bdeb6c1936ccdd4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:59.070801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:59.076005 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:59.095937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43e68a-04c6-45b5-81d3-113242f3aa6f admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:59.167762 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:59.168644 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.168933 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.169208 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] PATH_INFO: `/v3/users/26d19ac89cbb48ad8d1d1af967b798b5` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.171807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d19ac89cbb48ad8d1d1af967b798b5)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:59.173833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:59.228802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d19ac89cbb48ad8d1d1af967b798b5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.237763 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d19ac89cbb48ad8d1d1af967b798b5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.248419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d19ac89cbb48ad8d1d1af967b798b5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.249147 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d19ac89cbb48ad8d1d1af967b798b5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.257083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:43:59.263062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c56b38af-c02d-4203-9194-2edd2260c4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d19ac89cbb48ad8d1d1af967b798b5'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.270795 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1090/2174] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:43:59 2022] DELETE /identity/v3/users/26d19ac89cbb48ad8d1d1af967b798b5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:59.616161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:43:59.617883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:59.638257 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f77418-575b-4926-8b90-890f57eb8dc6 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:43:59.733571 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:43:59.734023 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.734307 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.734587 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] PATH_INFO: `/v3/projects/8e0229b9bf0c427f87cd64b36ef81668` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.735892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0229b9bf0c427f87cd64b36ef81668)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:43:59.738022 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:43:59.797839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0229b9bf0c427f87cd64b36ef81668', 'request_id': 'req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.811287 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0229b9bf0c427f87cd64b36ef81668', 'request_id': 'req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.818926 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0229b9bf0c427f87cd64b36ef81668', 'request_id': 'req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.833149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] The token cache is being invalidate because project 8e0229b9bf0c427f87cd64b36ef81668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:43:59.833354 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.834006 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-4b20b6c2-22df-4041-8cbf-dc0082ded0b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:43:59.836175 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1085/2175] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:43:59 2022] DELETE /identity/v3/projects/8e0229b9bf0c427f87cd64b36ef81668 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:43:59.841190 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc3cc6-51e3-4311-a64b-df7433388c4c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.841478 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc3cc6-51e3-4311-a64b-df7433388c4c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.841759 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc3cc6-51e3-4311-a64b-df7433388c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.861710 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-94bc3cc6-51e3-4311-a64b-df7433388c4c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:59.862934 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-94bc3cc6-51e3-4311-a64b-df7433388c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:59.931483 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1091/2176] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:43:59.939546 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689fee8-b725-4424-892a-5b1a81435e73 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:43:59.940094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689fee8-b725-4424-892a-5b1a81435e73 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:43:59.940375 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689fee8-b725-4424-892a-5b1a81435e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:43:59.968547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-5689fee8-b725-4424-892a-5b1a81435e73 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:43:59.969763 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-5689fee8-b725-4424-892a-5b1a81435e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:43:59.981064 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1086/2177] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:43:59.985712 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc3cc6-51e3-4311-a64b-df7433388c4c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.004977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc3cc6-51e3-4311-a64b-df7433388c4c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.013232 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.014001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.014303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.014868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.015550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:00.015912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.018522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.037438 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1092/2178] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:00.039118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689fee8-b725-4424-892a-5b1a81435e73 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.055380 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689fee8-b725-4424-892a-5b1a81435e73 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.062673 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66bd90-971d-40e7-865a-a9b4a26fa54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.063326 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66bd90-971d-40e7-865a-a9b4a26fa54b admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.063612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66bd90-971d-40e7-865a-a9b4a26fa54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.063912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66bd90-971d-40e7-865a-a9b4a26fa54b admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.064558 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66bd90-971d-40e7-865a-a9b4a26fa54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.066541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66bd90-971d-40e7-865a-a9b4a26fa54b admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.102220 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1087/2179] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:00 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:00.106099 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.117302 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65703b5-c011-4d2f-ae88-1474cfc75c4c admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.197209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c908aac-9010-430e-87da-15acfc6d55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.197953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c908aac-9010-430e-87da-15acfc6d55fb admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.198309 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c908aac-9010-430e-87da-15acfc6d55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.198651 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c908aac-9010-430e-87da-15acfc6d55fb admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.199363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c908aac-9010-430e-87da-15acfc6d55fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.201369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c908aac-9010-430e-87da-15acfc6d55fb admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.241987 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1093/2180] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:00 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:00.243317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66bd90-971d-40e7-865a-a9b4a26fa54b admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.256465 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66bd90-971d-40e7-865a-a9b4a26fa54b admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.262344 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c1de-98a3-4faa-b93b-3bb7102a338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.263101 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c1de-98a3-4faa-b93b-3bb7102a338a admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.263415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c1de-98a3-4faa-b93b-3bb7102a338a admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.263688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9c1de-98a3-4faa-b93b-3bb7102a338a admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.267842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c1de-98a3-4faa-b93b-3bb7102a338a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.268833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9c1de-98a3-4faa-b93b-3bb7102a338a admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.287348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1088/2181] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:00.291100 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c908aac-9010-430e-87da-15acfc6d55fb admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.302487 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c908aac-9010-430e-87da-15acfc6d55fb admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.313785 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb2d52-95f7-426c-a6e0-35a9a474fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.314583 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2d52-95f7-426c-a6e0-35a9a474fea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.315591 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2d52-95f7-426c-a6e0-35a9a474fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.315976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb2d52-95f7-426c-a6e0-35a9a474fea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.317033 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb2d52-95f7-426c-a6e0-35a9a474fea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.320863 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb2d52-95f7-426c-a6e0-35a9a474fea7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.337176 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1094/2182] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:00.341350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c1de-98a3-4faa-b93b-3bb7102a338a admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.351717 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9c1de-98a3-4faa-b93b-3bb7102a338a admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.356603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.357294 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.357575 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.357852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] PATH_INFO: `/v3/projects/5346991e58df4d48a668d30129a2a569/users/d6afcbcfacb2423d887f23c0807ef3e2/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.385276 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5346991e58df4d48a668d30129a2a569, user_id=d6afcbcfacb2423d887f23c0807ef3e2, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.388188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.423359 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1089/2183] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:00 2022] PUT /identity/v3/projects/5346991e58df4d48a668d30129a2a569/users/d6afcbcfacb2423d887f23c0807ef3e2/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:00.437521 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763c6b-0200-446a-b93f-901cb0be3b14 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.438040 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763c6b-0200-446a-b93f-901cb0be3b14 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.438493 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763c6b-0200-446a-b93f-901cb0be3b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.481953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-2d763c6b-0200-446a-b93f-901cb0be3b14 None None] MFA Rules not processed for user `d6afcbcfacb2423d887f23c0807ef3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:00.483570 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2d763c6b-0200-446a-b93f-901cb0be3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:00.546489 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:00.577540 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1095/2184] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:00.599213 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:00.601919 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:00.614423 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:00.694385 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b1c79-7e21-4670-ae30-8ba6fb645012 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:00.703975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2216-3ad6-435a-a15b-5c331afb470f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df1a3f053649456d982dd6c2d45d23c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:00.703975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2216-3ad6-435a-a15b-5c331afb470f service glance] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:00.703975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2216-3ad6-435a-a15b-5c331afb470f service glance] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:00.703975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2216-3ad6-435a-a15b-5c331afb470f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:00.732957 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be2216-3ad6-435a-a15b-5c331afb470f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:00.734791 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be2216-3ad6-435a-a15b-5c331afb470f service glance] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:00.752765 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1090/2185] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:01.518904 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763c6b-0200-446a-b93f-901cb0be3b14 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:01.520462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2d763c6b-0200-446a-b93f-901cb0be3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:01.589511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763c6b-0200-446a-b93f-901cb0be3b14 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:01.594063 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:01.594695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:01.594976 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:01.595248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] PATH_INFO: `/v3/users/c0a97aa2248e465fa43e66fd74fb96d8` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:01.596374 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a97aa2248e465fa43e66fd74fb96d8)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:01.598271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:01.649876 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a97aa2248e465fa43e66fd74fb96d8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.657069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a97aa2248e465fa43e66fd74fb96d8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.664670 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a97aa2248e465fa43e66fd74fb96d8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.665325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a97aa2248e465fa43e66fd74fb96d8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.677494 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-8654bfce-f72a-4577-a0ae-30fcb3895840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a97aa2248e465fa43e66fd74fb96d8'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:01.684376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1096/2186] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:01 2022] DELETE /identity/v3/users/c0a97aa2248e465fa43e66fd74fb96d8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:01.942828 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2216-3ad6-435a-a15b-5c331afb470f service glance] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:01.973839 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2216-3ad6-435a-a15b-5c331afb470f service glance] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.036766 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.037413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.037687 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.038479 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] PATH_INFO: `/v3/projects/e8490fae54e64656b7034bbeb40a5ab3` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.039623 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8490fae54e64656b7034bbeb40a5ab3)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.041798 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.089118 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8490fae54e64656b7034bbeb40a5ab3', 'request_id': 'req-ea8608b2-c4e7-4a37-99b6-db617928c0f1'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:02.095262 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8490fae54e64656b7034bbeb40a5ab3', 'request_id': 'req-ea8608b2-c4e7-4a37-99b6-db617928c0f1'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:02.101304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8490fae54e64656b7034bbeb40a5ab3', 'request_id': 'req-ea8608b2-c4e7-4a37-99b6-db617928c0f1'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:02.112787 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] The token cache is being invalidate because project e8490fae54e64656b7034bbeb40a5ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:02.113090 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:02.113892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-ea8608b2-c4e7-4a37-99b6-db617928c0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:02.115760 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1091/2187] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:01 2022] DELETE /identity/v3/projects/e8490fae54e64656b7034bbeb40a5ab3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:02.121277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c435b2-d0c7-43b1-bb16-2b821eb5ec68 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.121569 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c435b2-d0c7-43b1-bb16-2b821eb5ec68 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.121846 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c435b2-d0c7-43b1-bb16-2b821eb5ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.142822 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-a0c435b2-d0c7-43b1-bb16-2b821eb5ec68 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:02.144399 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-a0c435b2-d0c7-43b1-bb16-2b821eb5ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.204989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1097/2188] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:02.212782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53c99-4c85-4a78-b387-a6f0746de988 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.213071 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53c99-4c85-4a78-b387-a6f0746de988 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.213348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade53c99-4c85-4a78-b387-a6f0746de988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.233322 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-ade53c99-4c85-4a78-b387-a6f0746de988 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:02.234538 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-ade53c99-4c85-4a78-b387-a6f0746de988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.244078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1092/2189] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:02.249714 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c435b2-d0c7-43b1-bb16-2b821eb5ec68 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.259329 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:02.267519 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c435b2-d0c7-43b1-bb16-2b821eb5ec68 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.274352 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.274995 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.275277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.275561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.276553 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:02.276922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.278778 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.292708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1098/2190] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:02.297015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade53c99-4c85-4a78-b387-a6f0746de988 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.306514 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade53c99-4c85-4a78-b387-a6f0746de988 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.311113 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90bd3d-5bbb-438c-82a3-ebe2f55922b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.311736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90bd3d-5bbb-438c-82a3-ebe2f55922b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.312045 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90bd3d-5bbb-438c-82a3-ebe2f55922b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.312315 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90bd3d-5bbb-438c-82a3-ebe2f55922b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.312945 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90bd3d-5bbb-438c-82a3-ebe2f55922b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.314842 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90bd3d-5bbb-438c-82a3-ebe2f55922b2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.343131 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1093/2191] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:02.347391 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.358376 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427335-96e3-4811-81bd-5e9fd8d67f9e admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.431708 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46864ba4-6d4c-406f-b2d9-a89ce8c55ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.438132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864ba4-6d4c-406f-b2d9-a89ce8c55ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.438132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864ba4-6d4c-406f-b2d9-a89ce8c55ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.438132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46864ba4-6d4c-406f-b2d9-a89ce8c55ebe admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.438132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46864ba4-6d4c-406f-b2d9-a89ce8c55ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.438132 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46864ba4-6d4c-406f-b2d9-a89ce8c55ebe admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.475843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1099/2192] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:02.479330 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90bd3d-5bbb-438c-82a3-ebe2f55922b2 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.494333 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90bd3d-5bbb-438c-82a3-ebe2f55922b2 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.499923 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a295ddb-0d47-4015-906f-1f8cf7e524e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.500655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295ddb-0d47-4015-906f-1f8cf7e524e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.500965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295ddb-0d47-4015-906f-1f8cf7e524e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.501250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295ddb-0d47-4015-906f-1f8cf7e524e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.502179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a295ddb-0d47-4015-906f-1f8cf7e524e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.504453 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a295ddb-0d47-4015-906f-1f8cf7e524e9 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.517173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1094/2193] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:02.521299 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46864ba4-6d4c-406f-b2d9-a89ce8c55ebe admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.533740 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46864ba4-6d4c-406f-b2d9-a89ce8c55ebe admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.539311 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841c313-35cf-406e-9951-aaef55aef53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.540135 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841c313-35cf-406e-9951-aaef55aef53e admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.540582 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841c313-35cf-406e-9951-aaef55aef53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.541017 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841c313-35cf-406e-9951-aaef55aef53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.541804 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841c313-35cf-406e-9951-aaef55aef53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.544349 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841c313-35cf-406e-9951-aaef55aef53e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.557072 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1100/2194] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:02.561549 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a295ddb-0d47-4015-906f-1f8cf7e524e9 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.567159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:02.575094 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a295ddb-0d47-4015-906f-1f8cf7e524e9 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.581132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.582488 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.582888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.583236 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] PATH_INFO: `/v3/projects/7882088602a3453dab1c8da363566131/users/1cb420e612a142faa3266590f16ef3e7/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.604060 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7882088602a3453dab1c8da363566131, user_id=1cb420e612a142faa3266590f16ef3e7, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.607159 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.624418 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1095/2195] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:02 2022] PUT /identity/v3/projects/7882088602a3453dab1c8da363566131/users/1cb420e612a142faa3266590f16ef3e7/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:02.629556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219c1c-3751-4d56-a3ae-4cc288170f04 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.629843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219c1c-3751-4d56-a3ae-4cc288170f04 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.630112 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219c1c-3751-4d56-a3ae-4cc288170f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.650088 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-23219c1c-3751-4d56-a3ae-4cc288170f04 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:02.651315 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-23219c1c-3751-4d56-a3ae-4cc288170f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.717812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1101/2196] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:02.728951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:02.730788 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:02.791198 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce8097-6cab-48fc-be5f-563c5cd80db6 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:02.794939 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:02.795550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:02.795872 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:02.796152 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:02.806947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:02.808658 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:02.828317 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1096/2197] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:07.323909 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76b94-5d68-4038-9803-2f9881a7f79b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.324426 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76b94-5d68-4038-9803-2f9881a7f79b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.324507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76b94-5d68-4038-9803-2f9881a7f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.356003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7ec76b94-5d68-4038-9803-2f9881a7f79b None None] MFA Rules not processed for user `1cb420e612a142faa3266590f16ef3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:07.357171 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7ec76b94-5d68-4038-9803-2f9881a7f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:07.440580 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:07.445417 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1102/2198] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:07.461407 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:07.462856 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:07.548609 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f0dc9-687a-4fe4-a5b2-34e134eb273e service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:07.555455 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:07.556137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:07.556422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:07.556697 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:07.566058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:07.567545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:07.579325 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1097/2199] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:09.539213 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfefca-3767-44e8-a903-8335925bc651 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:09.539937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfefca-3767-44e8-a903-8335925bc651 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:09.539937 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfefca-3767-44e8-a903-8335925bc651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:09.571443 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5cdfefca-3767-44e8-a903-8335925bc651 None None] MFA Rules not processed for user `1cb420e612a142faa3266590f16ef3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:09.572828 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5cdfefca-3767-44e8-a903-8335925bc651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:09.584578 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1103/2200] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:10.818550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:10.820245 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:10.846390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb83c68-c435-47da-97ed-cd422a305b59 service nova] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:10.866391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:10.868541 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:10.868823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:10.869100 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] PATH_INFO: `/v3/users/18b146f966a943f3bc1719ff9a37412b` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:10.872567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b146f966a943f3bc1719ff9a37412b)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:10.875278 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:10.952357 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b146f966a943f3bc1719ff9a37412b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:10.953137 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b146f966a943f3bc1719ff9a37412b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:10.971712 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b146f966a943f3bc1719ff9a37412b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:10.972825 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b146f966a943f3bc1719ff9a37412b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:10.978749 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:10.986212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b146f966a943f3bc1719ff9a37412b'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.012826 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1098/2201] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:10 2022] DELETE /identity/v3/users/18b146f966a943f3bc1719ff9a37412b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:11.017597 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a8328-8e97-4c05-ab28-8df16a6e94a3 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.018451 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a8328-8e97-4c05-ab28-8df16a6e94a3 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.018912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a8328-8e97-4c05-ab28-8df16a6e94a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.042462 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d09a8328-8e97-4c05-ab28-8df16a6e94a3 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:11.044012 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d09a8328-8e97-4c05-ab28-8df16a6e94a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.110480 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1104/2202] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:11.120748 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.123413 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.193097 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5921b78-dd31-427b-b774-4b7a4af73e30 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.198569 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9cfbe-951b-444d-95f7-0cf8771ef822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.199198 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9cfbe-951b-444d-95f7-0cf8771ef822 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.199477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9cfbe-951b-444d-95f7-0cf8771ef822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.199952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9cfbe-951b-444d-95f7-0cf8771ef822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.213173 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9cfbe-951b-444d-95f7-0cf8771ef822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.214693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9cfbe-951b-444d-95f7-0cf8771ef822 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.225792 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1099/2203] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:44:11.554964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a8328-8e97-4c05-ab28-8df16a6e94a3 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.556573 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d09a8328-8e97-4c05-ab28-8df16a6e94a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.571751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a8328-8e97-4c05-ab28-8df16a6e94a3 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.578059 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.578744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.579029 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.579513 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] PATH_INFO: `/v3/projects/28ef67703bc349acaeac8e314332348a` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.580693 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ef67703bc349acaeac8e314332348a)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.582613 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.645762 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ef67703bc349acaeac8e314332348a', 'request_id': 'req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.651638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ef67703bc349acaeac8e314332348a', 'request_id': 'req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.659142 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ef67703bc349acaeac8e314332348a', 'request_id': 'req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.671274 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] The token cache is being invalidate because project 28ef67703bc349acaeac8e314332348a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:11.671569 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.672366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-c31ce5d8-68b5-458a-8622-498ac8f0f8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:11.673931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1105/2204] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:11 2022] DELETE /identity/v3/projects/28ef67703bc349acaeac8e314332348a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:11.679927 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3efa3-ba83-4e6c-9338-646e4992c328 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.680292 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3efa3-ba83-4e6c-9338-646e4992c328 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.680644 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3efa3-ba83-4e6c-9338-646e4992c328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.700552 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-88b3efa3-ba83-4e6c-9338-646e4992c328 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:11.701889 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-88b3efa3-ba83-4e6c-9338-646e4992c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.776468 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1100/2205] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:11.784479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc97eb-1a4b-4e65-bd2d-80b838799ae9 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.784845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc97eb-1a4b-4e65-bd2d-80b838799ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.785195 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc97eb-1a4b-4e65-bd2d-80b838799ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.812833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-07fc97eb-1a4b-4e65-bd2d-80b838799ae9 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:11.816295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-07fc97eb-1a4b-4e65-bd2d-80b838799ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:11.826057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1106/2206] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:11.830233 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3efa3-ba83-4e6c-9338-646e4992c328 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.842909 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3efa3-ba83-4e6c-9338-646e4992c328 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.850343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.851205 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.851568 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.852145 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.852982 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:11.853367 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.855445 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.869991 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1101/2207] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:11.874542 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc97eb-1a4b-4e65-bd2d-80b838799ae9 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.886477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc97eb-1a4b-4e65-bd2d-80b838799ae9 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:11.892953 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859ce4-38c8-4dcf-99cb-4e2cc7bc53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:11.894013 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859ce4-38c8-4dcf-99cb-4e2cc7bc53b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:11.894524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859ce4-38c8-4dcf-99cb-4e2cc7bc53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:11.895151 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6859ce4-38c8-4dcf-99cb-4e2cc7bc53b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:11.896194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6859ce4-38c8-4dcf-99cb-4e2cc7bc53b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:11.899879 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6859ce4-38c8-4dcf-99cb-4e2cc7bc53b3 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:11.954120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1107/2208] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:11 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:11.954343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:11.966072 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0033818-5def-444d-a8a4-ee7c1275e4e0 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.030350 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911c4a-e0c9-4f74-9de9-4bd9060ffafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.030967 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911c4a-e0c9-4f74-9de9-4bd9060ffafa admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.031250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911c4a-e0c9-4f74-9de9-4bd9060ffafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.031526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911c4a-e0c9-4f74-9de9-4bd9060ffafa admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.032164 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911c4a-e0c9-4f74-9de9-4bd9060ffafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.034086 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911c4a-e0c9-4f74-9de9-4bd9060ffafa admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.050629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:12.057340 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1102/2209] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:11 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:12.061115 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859ce4-38c8-4dcf-99cb-4e2cc7bc53b3 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.071973 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6859ce4-38c8-4dcf-99cb-4e2cc7bc53b3 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.076908 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459990c-363a-4fdc-8ee3-0fcacf23c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.077520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459990c-363a-4fdc-8ee3-0fcacf23c3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.077801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459990c-363a-4fdc-8ee3-0fcacf23c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.078076 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459990c-363a-4fdc-8ee3-0fcacf23c3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.078715 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459990c-363a-4fdc-8ee3-0fcacf23c3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.080333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459990c-363a-4fdc-8ee3-0fcacf23c3a1 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.091083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1108/2210] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:12.095054 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911c4a-e0c9-4f74-9de9-4bd9060ffafa admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.105657 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911c4a-e0c9-4f74-9de9-4bd9060ffafa admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.110402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf697a-421a-4e37-827d-0400b7649cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.111031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf697a-421a-4e37-827d-0400b7649cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.111310 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf697a-421a-4e37-827d-0400b7649cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.111583 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf697a-421a-4e37-827d-0400b7649cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.112260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf697a-421a-4e37-827d-0400b7649cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.113863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf697a-421a-4e37-827d-0400b7649cb2 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.125301 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1103/2211] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:12.129577 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459990c-363a-4fdc-8ee3-0fcacf23c3a1 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.140331 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459990c-363a-4fdc-8ee3-0fcacf23c3a1 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.145604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.146612 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.147569 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.147832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] PATH_INFO: `/v3/projects/dfc958445a1a40b293f8654409a64a88/users/8cac3046d6d3473db0983390bc849af0/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.164104 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc958445a1a40b293f8654409a64a88, user_id=8cac3046d6d3473db0983390bc849af0, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.166775 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.179511 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1109/2212] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:12 2022] PUT /identity/v3/projects/dfc958445a1a40b293f8654409a64a88/users/8cac3046d6d3473db0983390bc849af0/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:12.191133 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87892ef-3e1b-41e8-949d-5f14bffe7c53 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.191422 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87892ef-3e1b-41e8-949d-5f14bffe7c53 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.191699 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87892ef-3e1b-41e8-949d-5f14bffe7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.222273 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-d87892ef-3e1b-41e8-949d-5f14bffe7c53 None None] MFA Rules not processed for user `8cac3046d6d3473db0983390bc849af0`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:12.223505 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-d87892ef-3e1b-41e8-949d-5f14bffe7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.301895 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1104/2213] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:12.314599 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:12.317512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:12.332077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:12.380295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19187e3d-87b7-4e51-9f22-2022df0498dc admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:12.384369 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd450a0-c72e-4a64-a110-44d0c130ec4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:12.384982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd450a0-c72e-4a64-a110-44d0c130ec4a service cinder] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:12.385254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd450a0-c72e-4a64-a110-44d0c130ec4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:12.385523 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd450a0-c72e-4a64-a110-44d0c130ec4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:12.393796 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd450a0-c72e-4a64-a110-44d0c130ec4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:12.395211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd450a0-c72e-4a64-a110-44d0c130ec4a service cinder] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:12.409732 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1110/2214] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:13.039074 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5261b-77b9-4282-8022-d7754bea579a None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:13.039577 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5261b-77b9-4282-8022-d7754bea579a None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:13.039667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5261b-77b9-4282-8022-d7754bea579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:13.058574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-7ad5261b-77b9-4282-8022-d7754bea579a None None] MFA Rules not processed for user `a18c7a64597242cc8c8e08582f06b305`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:13.059803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7ad5261b-77b9-4282-8022-d7754bea579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:13.115608 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1105/2215] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:22.401982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=20 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:23.108628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=63 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:38.623761 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd450a0-c72e-4a64-a110-44d0c130ec4a service cinder] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:38.693056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd450a0-c72e-4a64-a110-44d0c130ec4a service cinder] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:38.699946 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:38.701079 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:38.701459 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:38.701832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] PATH_INFO: `/v3/users/8cac3046d6d3473db0983390bc849af0` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:38.703547 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cac3046d6d3473db0983390bc849af0)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:38.706526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:38.763337 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cac3046d6d3473db0983390bc849af0'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.770181 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cac3046d6d3473db0983390bc849af0'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.777435 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cac3046d6d3473db0983390bc849af0'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.778046 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cac3046d6d3473db0983390bc849af0'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.790362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cac3046d6d3473db0983390bc849af0'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:38.796419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1111/2216] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:38 2022] DELETE /identity/v3/users/8cac3046d6d3473db0983390bc849af0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:38.800852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb68f9-a26f-4b2b-8cdf-0033b852dcc0 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:38.801334 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb68f9-a26f-4b2b-8cdf-0033b852dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:38.801472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb68f9-a26f-4b2b-8cdf-0033b852dcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:38.820390 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-a6cb68f9-a26f-4b2b-8cdf-0033b852dcc0 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:38.821567 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-a6cb68f9-a26f-4b2b-8cdf-0033b852dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:38.889789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1106/2217] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:38.896402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:38.898067 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:38.960106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725800b0-9b15-45b8-998f-694c93a293b4 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:38.964193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2515-9a78-4831-8e42-2cc07d61ad47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:38.964810 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2515-9a78-4831-8e42-2cc07d61ad47 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:38.965096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2515-9a78-4831-8e42-2cc07d61ad47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:38.965378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2515-9a78-4831-8e42-2cc07d61ad47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:38.974741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2515-9a78-4831-8e42-2cc07d61ad47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:38.976242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2515-9a78-4831-8e42-2cc07d61ad47 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:38.985615 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1112/2218] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:39.264403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb68f9-a26f-4b2b-8cdf-0033b852dcc0 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.265877 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-a6cb68f9-a26f-4b2b-8cdf-0033b852dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:39.277606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb68f9-a26f-4b2b-8cdf-0033b852dcc0 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.282303 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.282940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.283222 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.283497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] PATH_INFO: `/v3/projects/dfc958445a1a40b293f8654409a64a88` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.284667 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc958445a1a40b293f8654409a64a88)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.286606 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.340735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc958445a1a40b293f8654409a64a88', 'request_id': 'req-a6addb4d-00cd-4f36-a22e-b04263dac08e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.346736 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc958445a1a40b293f8654409a64a88', 'request_id': 'req-a6addb4d-00cd-4f36-a22e-b04263dac08e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.352916 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc958445a1a40b293f8654409a64a88', 'request_id': 'req-a6addb4d-00cd-4f36-a22e-b04263dac08e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.363985 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] The token cache is being invalidate because project dfc958445a1a40b293f8654409a64a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:39.364277 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.364886 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-a6addb4d-00cd-4f36-a22e-b04263dac08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:39.366349 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1107/2219] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:39 2022] DELETE /identity/v3/projects/dfc958445a1a40b293f8654409a64a88 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:39.371986 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5646f4-80ce-42ce-8b3f-1e6ffb6c687c None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.372271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5646f4-80ce-42ce-8b3f-1e6ffb6c687c None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.372545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5646f4-80ce-42ce-8b3f-1e6ffb6c687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.391749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5b5646f4-80ce-42ce-8b3f-1e6ffb6c687c None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:39.392960 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5b5646f4-80ce-42ce-8b3f-1e6ffb6c687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:39.410290 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:39.457655 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1113/2220] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:44:39.467526 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b8e7-dcaa-4428-8b50-a8a24f3d5f81 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.468188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b8e7-dcaa-4428-8b50-a8a24f3d5f81 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.468188 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b8e7-dcaa-4428-8b50-a8a24f3d5f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.488968 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-9fa7b8e7-dcaa-4428-8b50-a8a24f3d5f81 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:39.490180 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9fa7b8e7-dcaa-4428-8b50-a8a24f3d5f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:39.499155 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1108/2221] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:39.503477 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5646f4-80ce-42ce-8b3f-1e6ffb6c687c None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.514481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5646f4-80ce-42ce-8b3f-1e6ffb6c687c None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.519719 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.520448 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.521077 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.521366 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.522038 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:39.522348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.524029 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.540134 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1114/2222] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 15:44:39.544261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7b8e7-dcaa-4428-8b50-a8a24f3d5f81 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.555062 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7b8e7-dcaa-4428-8b50-a8a24f3d5f81 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.559830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f4417-5a0a-4834-ad6a-3c1382e83748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.560473 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f4417-5a0a-4834-ad6a-3c1382e83748 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.560750 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f4417-5a0a-4834-ad6a-3c1382e83748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.561019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f4417-5a0a-4834-ad6a-3c1382e83748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.561653 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f4417-5a0a-4834-ad6a-3c1382e83748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.563592 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f4417-5a0a-4834-ad6a-3c1382e83748 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.591530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1109/2223] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:39 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:39.595656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.605994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500074b1-14f0-4119-91d6-1d6e35398d74 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.662253 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964a79-f04d-432d-acf3-78608c6eaacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.662984 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964a79-f04d-432d-acf3-78608c6eaacd admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.663332 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964a79-f04d-432d-acf3-78608c6eaacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.664230 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c964a79-f04d-432d-acf3-78608c6eaacd admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.664878 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c964a79-f04d-432d-acf3-78608c6eaacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.666833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c964a79-f04d-432d-acf3-78608c6eaacd admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.687556 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1115/2224] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:39 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:39.691789 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f4417-5a0a-4834-ad6a-3c1382e83748 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.702149 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f4417-5a0a-4834-ad6a-3c1382e83748 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.706754 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320107-2bb6-4413-8173-8b1bf0ecb9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.707353 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320107-2bb6-4413-8173-8b1bf0ecb9be admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.707633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320107-2bb6-4413-8173-8b1bf0ecb9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.707999 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1320107-2bb6-4413-8173-8b1bf0ecb9be admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.708582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1320107-2bb6-4413-8173-8b1bf0ecb9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.710183 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1320107-2bb6-4413-8173-8b1bf0ecb9be admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.720358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1110/2225] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:39.724056 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964a79-f04d-432d-acf3-78608c6eaacd admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.742537 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c964a79-f04d-432d-acf3-78608c6eaacd admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.747218 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e35b86-513d-4aee-98e5-4572344e5ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.747866 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e35b86-513d-4aee-98e5-4572344e5ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.748183 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e35b86-513d-4aee-98e5-4572344e5ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.748461 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e35b86-513d-4aee-98e5-4572344e5ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.749201 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e35b86-513d-4aee-98e5-4572344e5ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.750964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e35b86-513d-4aee-98e5-4572344e5ef3 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.762836 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1116/2226] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:39.767005 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320107-2bb6-4413-8173-8b1bf0ecb9be admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.777614 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1320107-2bb6-4413-8173-8b1bf0ecb9be admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.782666 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.783383 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.783755 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.784134 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] PATH_INFO: `/v3/projects/0eee3852ca374fb8bf11e06a42d07fec/users/962f212c63ea460687b501be5bc412bc/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.799365 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eee3852ca374fb8bf11e06a42d07fec, user_id=962f212c63ea460687b501be5bc412bc, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.802087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.814506 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1111/2227] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:39 2022] PUT /identity/v3/projects/0eee3852ca374fb8bf11e06a42d07fec/users/962f212c63ea460687b501be5bc412bc/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:39.819497 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a6b2-f535-4200-9670-c41720a292f7 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.819832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a6b2-f535-4200-9670-c41720a292f7 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.820120 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6a6b2-f535-4200-9670-c41720a292f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.839111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d0f6a6b2-f535-4200-9670-c41720a292f7 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:39.840345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d0f6a6b2-f535-4200-9670-c41720a292f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:39.898747 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1117/2228] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:39.908208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:39.909930 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:39.931972 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:39.973681 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504e982-482a-4774-80f5-013bed771884 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:39.977905 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7ef50-56f5-4964-9296-bd122b2f5597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:39.978533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7ef50-56f5-4964-9296-bd122b2f5597 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:39.978797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7ef50-56f5-4964-9296-bd122b2f5597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:39.979070 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7ef50-56f5-4964-9296-bd122b2f5597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:39.988106 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7ef50-56f5-4964-9296-bd122b2f5597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:39.989550 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7ef50-56f5-4964-9296-bd122b2f5597 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:39.999284 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1112/2229] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:44.377194 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9873-85d2-4d50-8542-3337028a15f2 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.377774 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9873-85d2-4d50-8542-3337028a15f2 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.378064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9873-85d2-4d50-8542-3337028a15f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.421891 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-979a9873-85d2-4d50-8542-3337028a15f2 None None] MFA Rules not processed for user `962f212c63ea460687b501be5bc412bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:44.423083 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-979a9873-85d2-4d50-8542-3337028a15f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:44.446348 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:44.539964 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1118/2230] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:44.544630 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7ef50-56f5-4964-9296-bd122b2f5597 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:44.555218 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7ef50-56f5-4964-9296-bd122b2f5597 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:44.560729 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aeac3-a4ae-41a7-9435-89aa3efc8b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:44.561352 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aeac3-a4ae-41a7-9435-89aa3efc8b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.561633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aeac3-a4ae-41a7-9435-89aa3efc8b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.561912 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aeac3-a4ae-41a7-9435-89aa3efc8b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.562551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601aeac3-a4ae-41a7-9435-89aa3efc8b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:44.564533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601aeac3-a4ae-41a7-9435-89aa3efc8b90 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:44.631142 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1113/2231] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:44 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:44.635382 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a9873-85d2-4d50-8542-3337028a15f2 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:44.660322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a9873-85d2-4d50-8542-3337028a15f2 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:44.756749 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e5e09-fdd3-4ddd-ae62-835596093e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:44.757507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5e09-fdd3-4ddd-ae62-835596093e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.757894 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5e09-fdd3-4ddd-ae62-835596093e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.758284 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5e09-fdd3-4ddd-ae62-835596093e0c admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.759057 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e5e09-fdd3-4ddd-ae62-835596093e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:44.761267 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e5e09-fdd3-4ddd-ae62-835596093e0c admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:44.795989 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1119/2232] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:44 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:44.800274 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aeac3-a4ae-41a7-9435-89aa3efc8b90 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:44.813348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aeac3-a4ae-41a7-9435-89aa3efc8b90 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:44.818123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f3269-2048-43ba-8794-c3bf7126131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:44.818797 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3269-2048-43ba-8794-c3bf7126131d admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.819078 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3269-2048-43ba-8794-c3bf7126131d admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.819374 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3269-2048-43ba-8794-c3bf7126131d admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.820083 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f3269-2048-43ba-8794-c3bf7126131d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:44.821713 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f3269-2048-43ba-8794-c3bf7126131d admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:44.833677 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1114/2233] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:44.838279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e5e09-fdd3-4ddd-ae62-835596093e0c admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:44.849043 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e5e09-fdd3-4ddd-ae62-835596093e0c admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:44.854845 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea88374-d96b-41e2-80b0-190ab61dd4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:44.855166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea88374-d96b-41e2-80b0-190ab61dd4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.855522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea88374-d96b-41e2-80b0-190ab61dd4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.855923 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea88374-d96b-41e2-80b0-190ab61dd4fe admin admin] PATH_INFO: `/v3/projects/bdf546c038de4985a2a3c87a73113ac8/users/f438704405854746a7177bf1a543c29d/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.874162 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea88374-d96b-41e2-80b0-190ab61dd4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf546c038de4985a2a3c87a73113ac8, user_id=f438704405854746a7177bf1a543c29d, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:44.877196 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea88374-d96b-41e2-80b0-190ab61dd4fe admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:44.893102 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1120/2234] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:44 2022] PUT /identity/v3/projects/bdf546c038de4985a2a3c87a73113ac8/users/f438704405854746a7177bf1a543c29d/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:44.896989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f3269-2048-43ba-8794-c3bf7126131d admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:44.907832 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f3269-2048-43ba-8794-c3bf7126131d admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:44.973679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:44.974297 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:44.974582 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:44.974855 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:44.975499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:44.977803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:44.988358 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1115/2235] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:44.993052 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea88374-d96b-41e2-80b0-190ab61dd4fe admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:45.003735 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea88374-d96b-41e2-80b0-190ab61dd4fe admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:45.009453 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bdbf6-f532-4e24-9544-5657ec6236cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:45.010123 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bdbf6-f532-4e24-9544-5657ec6236cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:45.010403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bdbf6-f532-4e24-9544-5657ec6236cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:45.010676 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bdbf6-f532-4e24-9544-5657ec6236cf admin admin] PATH_INFO: `/v3/projects/bdf546c038de4985a2a3c87a73113ac8/users/f438704405854746a7177bf1a543c29d/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:45.012633 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bdbf6-f532-4e24-9544-5657ec6236cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf546c038de4985a2a3c87a73113ac8, user_id=f438704405854746a7177bf1a543c29d, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:45.015270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bdbf6-f532-4e24-9544-5657ec6236cf admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:45.026424 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1121/2236] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:44 2022] PUT /identity/v3/projects/bdf546c038de4985a2a3c87a73113ac8/users/f438704405854746a7177bf1a543c29d/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:44:47.674015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:47.677127 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:47.698528 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fc901-1302-4d54-a307-aa61d8503a54 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:47.830556 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:47.831449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:47.831888 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:47.832426 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] PATH_INFO: `/v3/users/d6afcbcfacb2423d887f23c0807ef3e2` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:47.834512 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6afcbcfacb2423d887f23c0807ef3e2)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:47.840540 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:47.894008 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:47.925700 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6afcbcfacb2423d887f23c0807ef3e2'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.927232 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6afcbcfacb2423d887f23c0807ef3e2'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.941150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6afcbcfacb2423d887f23c0807ef3e2'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.953332 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6afcbcfacb2423d887f23c0807ef3e2'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:47.965377 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6afcbcfacb2423d887f23c0807ef3e2'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:48.016633 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1116/2237] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:44:47 2022] DELETE /identity/v3/users/d6afcbcfacb2423d887f23c0807ef3e2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:48.030707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a0570-5bc9-44a1-bc40-69cb49e1f7f4 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.030707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a0570-5bc9-44a1-bc40-69cb49e1f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.030707 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a0570-5bc9-44a1-bc40-69cb49e1f7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.062372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-2e7a0570-5bc9-44a1-bc40-69cb49e1f7f4 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:48.066028 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2e7a0570-5bc9-44a1-bc40-69cb49e1f7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.204944 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1122/2238] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:48.214398 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:48.215964 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:48.318782 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b857da3-d5f5-471d-83eb-6e575e9fe1d1 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:48.327728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5a29-7372-4b0b-af2d-a26b8920667a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:48.328403 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5a29-7372-4b0b-af2d-a26b8920667a service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:48.328683 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5a29-7372-4b0b-af2d-a26b8920667a service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:48.328954 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5a29-7372-4b0b-af2d-a26b8920667a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:48.342087 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5a29-7372-4b0b-af2d-a26b8920667a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:48.344088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5a29-7372-4b0b-af2d-a26b8920667a service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:48.357227 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1117/2239] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:49.248615 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a0570-5bc9-44a1-bc40-69cb49e1f7f4 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.250678 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-2e7a0570-5bc9-44a1-bc40-69cb49e1f7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.277014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a0570-5bc9-44a1-bc40-69cb49e1f7f4 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.284269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.286192 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.286541 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.286881 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] PATH_INFO: `/v3/projects/5346991e58df4d48a668d30129a2a569` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.288476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5346991e58df4d48a668d30129a2a569)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.292731 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.303979 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:49.383672 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5346991e58df4d48a668d30129a2a569', 'request_id': 'req-632f355c-288b-4c0f-907e-258ecc0dcac4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.391561 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5346991e58df4d48a668d30129a2a569', 'request_id': 'req-632f355c-288b-4c0f-907e-258ecc0dcac4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.403182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5346991e58df4d48a668d30129a2a569', 'request_id': 'req-632f355c-288b-4c0f-907e-258ecc0dcac4'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.417975 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] The token cache is being invalidate because project 5346991e58df4d48a668d30129a2a569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81746) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:44:49.418420 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.419211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-632f355c-288b-4c0f-907e-258ecc0dcac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:44:49.421402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1123/2240] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:44:49 2022] DELETE /identity/v3/projects/5346991e58df4d48a668d30129a2a569 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:49.426289 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcba4f-49ac-4c29-bdbb-59aef8b5a26d None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.426805 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcba4f-49ac-4c29-bdbb-59aef8b5a26d None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.427165 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcba4f-49ac-4c29-bdbb-59aef8b5a26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.472636 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-44dcba4f-49ac-4c29-bdbb-59aef8b5a26d None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:49.474321 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-44dcba4f-49ac-4c29-bdbb-59aef8b5a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.606892 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1118/2241] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:49.615158 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a7273-1b02-45d9-96ed-b49e9978fc11 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.615507 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a7273-1b02-45d9-96ed-b49e9978fc11 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.615832 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a7273-1b02-45d9-96ed-b49e9978fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.648244 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-d78a7273-1b02-45d9-96ed-b49e9978fc11 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:49.649481 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d78a7273-1b02-45d9-96ed-b49e9978fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:49.659172 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1124/2242] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:49.663385 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcba4f-49ac-4c29-bdbb-59aef8b5a26d None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.674472 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcba4f-49ac-4c29-bdbb-59aef8b5a26d None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.682338 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.683324 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.683894 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.684343 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.685746 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:44:49.686212 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.688123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.711827 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1119/2243] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:44:49.716921 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a7273-1b02-45d9-96ed-b49e9978fc11 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.728254 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a7273-1b02-45d9-96ed-b49e9978fc11 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.733286 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0a85-b1d2-408d-a51a-e71594d4333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.733915 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0a85-b1d2-408d-a51a-e71594d4333f admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.734184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0a85-b1d2-408d-a51a-e71594d4333f admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.734458 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f0a85-b1d2-408d-a51a-e71594d4333f admin admin] PATH_INFO: `/v3/projects` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.736607 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f0a85-b1d2-408d-a51a-e71594d4333f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.737926 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f0a85-b1d2-408d-a51a-e71594d4333f admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.795131 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1125/2244] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:49.799688 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.814007 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226311f-83be-4742-97fc-c1080cb3af52 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.862096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:49.906993 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353fee4-0c4b-4cb6-bea5-7e5baa5f1486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.907975 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fee4-0c4b-4cb6-bea5-7e5baa5f1486 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.908363 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fee4-0c4b-4cb6-bea5-7e5baa5f1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.908741 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fee4-0c4b-4cb6-bea5-7e5baa5f1486 admin admin] PATH_INFO: `/v3/users` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:49.909612 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353fee4-0c4b-4cb6-bea5-7e5baa5f1486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:49.911761 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353fee4-0c4b-4cb6-bea5-7e5baa5f1486 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:49.948012 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1120/2245] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:49 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:49.949379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0a85-b1d2-408d-a51a-e71594d4333f admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:49.972752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f0a85-b1d2-408d-a51a-e71594d4333f admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:49.988522 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93203d5-ca9c-41ed-bc2f-e8012376a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:49.989403 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93203d5-ca9c-41ed-bc2f-e8012376a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:49.989786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93203d5-ca9c-41ed-bc2f-e8012376a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:49.990809 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93203d5-ca9c-41ed-bc2f-e8012376a9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.000307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93203d5-ca9c-41ed-bc2f-e8012376a9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.006434 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93203d5-ca9c-41ed-bc2f-e8012376a9f0 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.029303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1126/2246] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:44:50.034616 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353fee4-0c4b-4cb6-bea5-7e5baa5f1486 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.048883 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353fee4-0c4b-4cb6-bea5-7e5baa5f1486 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.056443 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718a153-e9af-4746-8bc2-ee54e6f209b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.057241 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718a153-e9af-4746-8bc2-ee54e6f209b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.057674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718a153-e9af-4746-8bc2-ee54e6f209b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.058053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718a153-e9af-4746-8bc2-ee54e6f209b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.058838 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718a153-e9af-4746-8bc2-ee54e6f209b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.060693 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718a153-e9af-4746-8bc2-ee54e6f209b1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.085954 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1121/2247] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 15:44:50.087680 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93203d5-ca9c-41ed-bc2f-e8012376a9f0 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.103219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93203d5-ca9c-41ed-bc2f-e8012376a9f0 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.109589 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.110524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.110939 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.111333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] PATH_INFO: `/v3/projects/43faeeb2524b4128b93fc962ae6b8222/users/91a881cf208d495891de3d8bff99070d/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.136931 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43faeeb2524b4128b93fc962ae6b8222, user_id=91a881cf208d495891de3d8bff99070d, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.140136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.159835 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1127/2248] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:44:50 2022] PUT /identity/v3/projects/43faeeb2524b4128b93fc962ae6b8222/users/91a881cf208d495891de3d8bff99070d/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:44:50.165261 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ec4c-972a-4e33-88b9-0ffb03d1f901 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.168439 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ec4c-972a-4e33-88b9-0ffb03d1f901 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.168772 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ec4c-972a-4e33-88b9-0ffb03d1f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.215437 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-4d11ec4c-972a-4e33-88b9-0ffb03d1f901 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:50.216947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-4d11ec4c-972a-4e33-88b9-0ffb03d1f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:50.335965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1122/2249] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:50.344843 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:50.348427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:50.644334 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106a1bf-ba9d-4522-ad56-2d16e2bbcb12 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:50.661525 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:50.663220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:50.663576 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:50.663970 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:50.690524 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:50.694060 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:50.738229 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1128/2250] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:52.695917 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180cef5-a407-429f-a03c-ec0b3cc91e15 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:52.696372 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180cef5-a407-429f-a03c-ec0b3cc91e15 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:52.696451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180cef5-a407-429f-a03c-ec0b3cc91e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:52.733639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-6180cef5-a407-429f-a03c-ec0b3cc91e15 None None] MFA Rules not processed for user `f438704405854746a7177bf1a543c29d`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:52.735421 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-6180cef5-a407-429f-a03c-ec0b3cc91e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:52.852663 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1123/2251] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:52.875300 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:52.877356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:52.964642 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:53.090018 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56dd6-400b-439c-8870-e27aff10ae35 service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:53.110062 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729e690-188a-46c8-aecf-4df1abd4096b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbf473d168b4c9692f75a51c84b7db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:53.111517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e690-188a-46c8-aecf-4df1abd4096b service nova] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:53.111851 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e690-188a-46c8-aecf-4df1abd4096b service nova] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:53.112136 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e690-188a-46c8-aecf-4df1abd4096b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:53.115166 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3729e690-188a-46c8-aecf-4df1abd4096b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:53.260064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729e690-188a-46c8-aecf-4df1abd4096b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:53.261752 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729e690-188a-46c8-aecf-4df1abd4096b service nova] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:53.277580 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1129/2252] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:44:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:44:55.078547 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aae87-28a3-4fe2-ad7e-578c28e600d7 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:55.079153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aae87-28a3-4fe2-ad7e-578c28e600d7 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:55.079153 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aae87-28a3-4fe2-ad7e-578c28e600d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:55.145523 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-a79aae87-28a3-4fe2-ad7e-578c28e600d7 None None] MFA Rules not processed for user `3c921ff0cbca40c7944ae3fb77cc96b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:55.152449 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-a79aae87-28a3-4fe2-ad7e-578c28e600d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:55.234562 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:55.265095 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1124/2253] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:55.810695 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e442-27c8-4d86-9b85-dd4d098e4af0 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:55.811216 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e442-27c8-4d86-9b85-dd4d098e4af0 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:55.811322 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e442-27c8-4d86-9b85-dd4d098e4af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:55.838812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-7a82e442-27c8-4d86-9b85-dd4d098e4af0 None None] MFA Rules not processed for user `962f212c63ea460687b501be5bc412bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:55.840117 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-7a82e442-27c8-4d86-9b85-dd4d098e4af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:55.848730 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1130/2254] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:56.945477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3640b-232e-409e-a7b2-3ab0df58cdae None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:56.946046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3640b-232e-409e-a7b2-3ab0df58cdae None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:56.946046 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3640b-232e-409e-a7b2-3ab0df58cdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:56.981593 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-cad3640b-232e-409e-a7b2-3ab0df58cdae None None] MFA Rules not processed for user `074e13c753f047968b2560b12d4b53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:56.982516 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-cad3640b-232e-409e-a7b2-3ab0df58cdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:57.105007 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1125/2255] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:58.564312 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7f1e-1326-4455-b15c-a06a338a34bb None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:58.565278 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7f1e-1326-4455-b15c-a06a338a34bb None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:58.565997 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7f1e-1326-4455-b15c-a06a338a34bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:58.611679 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-4c3c7f1e-1326-4455-b15c-a06a338a34bb None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:58.617374 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4c3c7f1e-1326-4455-b15c-a06a338a34bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:58.813802 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1131/2256] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:44:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:58.919762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3640b-232e-409e-a7b2-3ab0df58cdae None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:58.921442 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-cad3640b-232e-409e-a7b2-3ab0df58cdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:59.094621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3640b-232e-409e-a7b2-3ab0df58cdae None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:59.113536 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cea8f-ac71-4194-a239-3fdd3894d741 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:59.114533 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cea8f-ac71-4194-a239-3fdd3894d741 service swift] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:59.115456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cea8f-ac71-4194-a239-3fdd3894d741 service swift] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:59.126084 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cea8f-ac71-4194-a239-3fdd3894d741 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:59.138721 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cea8f-ac71-4194-a239-3fdd3894d741 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:59.140965 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cea8f-ac71-4194-a239-3fdd3894d741 service swift] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:59.151280 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1126/2257] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:44:59.193994 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cbb2-0eb9-4f19-b59e-faf303a4f967 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:59.195627 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cbb2-0eb9-4f19-b59e-faf303a4f967 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:59.196203 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255cbb2-0eb9-4f19-b59e-faf303a4f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:59.274365 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-8255cbb2-0eb9-4f19-b59e-faf303a4f967 None None] MFA Rules not processed for user `91a881cf208d495891de3d8bff99070d`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:44:59.277182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-8255cbb2-0eb9-4f19-b59e-faf303a4f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:44:59.507977 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=100 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:44:59.539296 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1132/2258] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:44:59.540004 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cea8f-ac71-4194-a239-3fdd3894d741 service swift] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:59.559737 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cea8f-ac71-4194-a239-3fdd3894d741 service swift] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:59.589661 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943f57f-5065-4204-92a2-2c4a41e26677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:59.590298 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f57f-5065-4204-92a2-2c4a41e26677 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:59.590574 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f57f-5065-4204-92a2-2c4a41e26677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:59.590845 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f57f-5065-4204-92a2-2c4a41e26677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:59.591495 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943f57f-5065-4204-92a2-2c4a41e26677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:59.601411 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943f57f-5065-4204-92a2-2c4a41e26677 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:59.710073 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1127/2259] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:44:59 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 15:44:59.713913 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cbb2-0eb9-4f19-b59e-faf303a4f967 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:59.729673 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255cbb2-0eb9-4f19-b59e-faf303a4f967 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:59.893372 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1013b45-7c94-4e66-838f-d38249908d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:59.894221 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013b45-7c94-4e66-838f-d38249908d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:59.894596 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013b45-7c94-4e66-838f-d38249908d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:59.895058 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013b45-7c94-4e66-838f-d38249908d74 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:59.896047 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1013b45-7c94-4e66-838f-d38249908d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:44:59.899875 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1013b45-7c94-4e66-838f-d38249908d74 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:44:59.968751 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1133/2260] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:44:59 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:44:59.969436 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943f57f-5065-4204-92a2-2c4a41e26677 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:44:59.989191 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943f57f-5065-4204-92a2-2c4a41e26677 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:44:59.995577 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4983947-53ee-420e-96dc-51a7de7384a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:44:59.996684 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983947-53ee-420e-96dc-51a7de7384a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:44:59.997304 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983947-53ee-420e-96dc-51a7de7384a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:44:59.997931 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983947-53ee-420e-96dc-51a7de7384a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:44:59.999088 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4983947-53ee-420e-96dc-51a7de7384a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:00.008508 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4983947-53ee-420e-96dc-51a7de7384a1 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:00.031986 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1128/2261] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:00.040757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1013b45-7c94-4e66-838f-d38249908d74 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:00.056559 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1013b45-7c94-4e66-838f-d38249908d74 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:00.064157 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe74b5c-d28b-4431-b987-74dee8a2f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:00.067182 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe74b5c-d28b-4431-b987-74dee8a2f2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:00.067717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe74b5c-d28b-4431-b987-74dee8a2f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:00.068214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe74b5c-d28b-4431-b987-74dee8a2f2b6 admin admin] PATH_INFO: `/v3/projects/bd1bc025c02f492f8cb5dfd38c2f4e0b/users/0413577f25da41e9a6e83cb20fc8e8bc/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:00.099324 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe74b5c-d28b-4431-b987-74dee8a2f2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1bc025c02f492f8cb5dfd38c2f4e0b, user_id=0413577f25da41e9a6e83cb20fc8e8bc, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:00.104520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe74b5c-d28b-4431-b987-74dee8a2f2b6 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:00.139667 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1134/2262] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:00 2022] PUT /identity/v3/projects/bd1bc025c02f492f8cb5dfd38c2f4e0b/users/0413577f25da41e9a6e83cb20fc8e8bc/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:00.144581 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4983947-53ee-420e-96dc-51a7de7384a1 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:00.157655 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4983947-53ee-420e-96dc-51a7de7384a1 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:00.265794 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:00.309260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2b557-188a-4eb5-85af-c62f0e777fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:00.310311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b557-188a-4eb5-85af-c62f0e777fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:00.312585 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b557-188a-4eb5-85af-c62f0e777fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:00.315016 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b557-188a-4eb5-85af-c62f0e777fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:00.316090 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2b557-188a-4eb5-85af-c62f0e777fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:00.318079 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2b557-188a-4eb5-85af-c62f0e777fcc admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:00.349603 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1129/2263] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:00.354378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe74b5c-d28b-4431-b987-74dee8a2f2b6 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:00.372757 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe74b5c-d28b-4431-b987-74dee8a2f2b6 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:00.398175 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:00.399035 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:00.399527 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:00.399948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] PATH_INFO: `/v3/projects/bd1bc025c02f492f8cb5dfd38c2f4e0b/users/0413577f25da41e9a6e83cb20fc8e8bc/roles/32319452053845419798d329f1c194d4` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:00.402422 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1bc025c02f492f8cb5dfd38c2f4e0b, user_id=0413577f25da41e9a6e83cb20fc8e8bc, role_id=32319452053845419798d329f1c194d4)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:00.405399 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:00.434486 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1135/2264] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:00 2022] PUT /identity/v3/projects/bd1bc025c02f492f8cb5dfd38c2f4e0b/users/0413577f25da41e9a6e83cb20fc8e8bc/roles/32319452053845419798d329f1c194d4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:09.810951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82426df1-85bd-49da-894f-6bbbb5ca8bb6 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:09.811502 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82426df1-85bd-49da-894f-6bbbb5ca8bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:09.811646 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82426df1-85bd-49da-894f-6bbbb5ca8bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:09.880058 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-82426df1-85bd-49da-894f-6bbbb5ca8bb6 None None] MFA Rules not processed for user `0413577f25da41e9a6e83cb20fc8e8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:09.881617 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-82426df1-85bd-49da-894f-6bbbb5ca8bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:10.108125 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1130/2265] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:10.422379 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=45,keystone:INSERT=5 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:10.556193 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:10.558271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:10.637479 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f769b7-cda2-4c86-8db0-05415386cee0 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:10.641452 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f171900-a0a5-4233-8af5-6d5c678d82dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df1a3f053649456d982dd6c2d45d23c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:10.642108 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171900-a0a5-4233-8af5-6d5c678d82dc service glance] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:10.642388 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171900-a0a5-4233-8af5-6d5c678d82dc service glance] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:10.642690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f171900-a0a5-4233-8af5-6d5c678d82dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:10.717454 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f171900-a0a5-4233-8af5-6d5c678d82dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:10.718912 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f171900-a0a5-4233-8af5-6d5c678d82dc service glance] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:10.730907 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1136/2266] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:11.041891 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd608ab-1ca6-4ea5-a4e7-3275608b94d0 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.042520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd608ab-1ca6-4ea5-a4e7-3275608b94d0 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.042520 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd608ab-1ca6-4ea5-a4e7-3275608b94d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.094275 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-9dd608ab-1ca6-4ea5-a4e7-3275608b94d0 None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:11.105179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-9dd608ab-1ca6-4ea5-a4e7-3275608b94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:11.230194 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1131/2267] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:11.258616 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f171900-a0a5-4233-8af5-6d5c678d82dc service glance] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:11.389248 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f171900-a0a5-4233-8af5-6d5c678d82dc service glance] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:11.394836 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c81844-ae20-4ccb-a6f7-fa84862be4c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:11.395472 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81844-ae20-4ccb-a6f7-fa84862be4c0 service swift] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:11.395758 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81844-ae20-4ccb-a6f7-fa84862be4c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:11.396069 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c81844-ae20-4ccb-a6f7-fa84862be4c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:11.412141 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c81844-ae20-4ccb-a6f7-fa84862be4c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:11.413789 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c81844-ae20-4ccb-a6f7-fa84862be4c0 service swift] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:11.431361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1137/2268] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:45:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:45:21.223013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=67 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:21.420517 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=80 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:24.949015 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384b3-918c-449b-b278-0389298d6a67 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:24.949947 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384b3-918c-449b-b278-0389298d6a67 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:24.950432 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a384b3-918c-449b-b278-0389298d6a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:24.981459 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-37a384b3-918c-449b-b278-0389298d6a67 None None] MFA Rules not processed for user `91a881cf208d495891de3d8bff99070d`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:24.986395 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-37a384b3-918c-449b-b278-0389298d6a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:24.997647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1132/2269] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:45:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:26.053867 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6055b2-708a-444c-a4d8-53c921908150 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:26.054419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6055b2-708a-444c-a4d8-53c921908150 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:26.054419 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6055b2-708a-444c-a4d8-53c921908150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:26.090568 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-9c6055b2-708a-444c-a4d8-53c921908150 None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:26.092177 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9c6055b2-708a-444c-a4d8-53c921908150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:26.101550 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1138/2270] 10.222.0.55 () {58 vars in 967 bytes} [Thu Sep 1 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:26.116425 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a384b3-918c-449b-b278-0389298d6a67 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:26.129483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a384b3-918c-449b-b278-0389298d6a67 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:26.135172 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5368b4-faa5-4dc6-8e07-25f7c50109b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:26.135804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5368b4-faa5-4dc6-8e07-25f7c50109b5 service swift] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:26.136080 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5368b4-faa5-4dc6-8e07-25f7c50109b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:26.136352 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5368b4-faa5-4dc6-8e07-25f7c50109b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:26.144963 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5368b4-faa5-4dc6-8e07-25f7c50109b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:26.147132 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5368b4-faa5-4dc6-8e07-25f7c50109b5 service swift] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:26.155179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1133/2271] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:45:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:45:26.484884 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0acabf-baf3-4a10-8f47-1bb788b13aa8 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:26.485197 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0acabf-baf3-4a10-8f47-1bb788b13aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:26.498781 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0acabf-baf3-4a10-8f47-1bb788b13aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:26.519307 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-0d0acabf-baf3-4a10-8f47-1bb788b13aa8 None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:26.521474 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-0d0acabf-baf3-4a10-8f47-1bb788b13aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:26.530081 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1139/2272] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:26.557497 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5368b4-faa5-4dc6-8e07-25f7c50109b5 service swift] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:26.572129 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5368b4-faa5-4dc6-8e07-25f7c50109b5 service swift] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:26.579258 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032d85-4cce-4f7f-a743-9b103bc3ffb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:26.580013 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032d85-4cce-4f7f-a743-9b103bc3ffb7 service swift] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:26.580624 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032d85-4cce-4f7f-a743-9b103bc3ffb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:26.580969 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032d85-4cce-4f7f-a743-9b103bc3ffb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:26.592482 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb032d85-4cce-4f7f-a743-9b103bc3ffb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:26.594124 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb032d85-4cce-4f7f-a743-9b103bc3ffb7 service swift] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:26.603821 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1134/2273] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:45:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:45:28.076078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155682d-8f47-41d5-9210-cdd8e7705433 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:28.076634 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155682d-8f47-41d5-9210-cdd8e7705433 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:28.076634 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155682d-8f47-41d5-9210-cdd8e7705433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:28.106812 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-c155682d-8f47-41d5-9210-cdd8e7705433 None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:28.108373 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c155682d-8f47-41d5-9210-cdd8e7705433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:28.118002 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1140/2274] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:45:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:28.141863 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032d85-4cce-4f7f-a743-9b103bc3ffb7 service swift] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:28.159179 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032d85-4cce-4f7f-a743-9b103bc3ffb7 service swift] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:28.182240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ac9c-8eee-4397-bbd2-0f7427f5e795 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:28.182989 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ac9c-8eee-4397-bbd2-0f7427f5e795 service swift] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:28.183346 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ac9c-8eee-4397-bbd2-0f7427f5e795 service swift] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:28.183753 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ac9c-8eee-4397-bbd2-0f7427f5e795 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:28.199103 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7ac9c-8eee-4397-bbd2-0f7427f5e795 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:28.205053 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7ac9c-8eee-4397-bbd2-0f7427f5e795 service swift] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:28.224696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1135/2275] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:45:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:45:28.910361 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155682d-8f47-41d5-9210-cdd8e7705433 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:28.912713 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-c155682d-8f47-41d5-9210-cdd8e7705433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:29.005096 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155682d-8f47-41d5-9210-cdd8e7705433 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:29.010727 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:29.011239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:29.011657 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:29.012071 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] PATH_INFO: `/v3/users/a18c7a64597242cc8c8e08582f06b305` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:29.014784 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18c7a64597242cc8c8e08582f06b305)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:29.017105 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:29.096830 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18c7a64597242cc8c8e08582f06b305'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.108741 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18c7a64597242cc8c8e08582f06b305'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.122805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18c7a64597242cc8c8e08582f06b305'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.123649 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18c7a64597242cc8c8e08582f06b305'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.142325 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-2d905147-d94d-4382-bb52-aa1d06440d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18c7a64597242cc8c8e08582f06b305'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.152378 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1141/2276] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:45:28 2022] DELETE /identity/v3/users/a18c7a64597242cc8c8e08582f06b305 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 15:45:29.412510 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ac9c-8eee-4397-bbd2-0f7427f5e795 service swift] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:29.430571 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ac9c-8eee-4397-bbd2-0f7427f5e795 service swift] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:29.559808 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:29.560599 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:29.561314 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:29.561873 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] PATH_INFO: `/v3/projects/917ab62e2f0e420d8c1f81d034d27de3` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:29.566903 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=917ab62e2f0e420d8c1f81d034d27de3)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:29.570642 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:29.709759 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917ab62e2f0e420d8c1f81d034d27de3', 'request_id': 'req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.742091 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917ab62e2f0e420d8c1f81d034d27de3', 'request_id': 'req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.749376 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917ab62e2f0e420d8c1f81d034d27de3', 'request_id': 'req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.826019 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] The token cache is being invalidate because project 917ab62e2f0e420d8c1f81d034d27de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:45:29.826460 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.830123 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0abc3eb9-a9ad-4c14-813f-6483abf5af5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:45:29.834260 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1136/2277] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:45:29 2022] DELETE /identity/v3/projects/917ab62e2f0e420d8c1f81d034d27de3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:29.839638 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb95e-0fd7-4d59-8314-10922a09cde9 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:29.840003 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb95e-0fd7-4d59-8314-10922a09cde9 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:29.840302 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb95e-0fd7-4d59-8314-10922a09cde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:29.868001 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-68cbb95e-0fd7-4d59-8314-10922a09cde9 None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:29.881601 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-68cbb95e-0fd7-4d59-8314-10922a09cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:30.046205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:30.079565 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1142/2278] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:30.087983 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158316-1579-44f5-8142-845ba9fea2da None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:30.088186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158316-1579-44f5-8142-845ba9fea2da None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:30.088400 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158316-1579-44f5-8142-845ba9fea2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:30.148551 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-c4158316-1579-44f5-8142-845ba9fea2da None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:30.149938 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-c4158316-1579-44f5-8142-845ba9fea2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:30.185647 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1137/2279] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:30.189905 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb95e-0fd7-4d59-8314-10922a09cde9 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:30.208940 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb95e-0fd7-4d59-8314-10922a09cde9 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:30.220271 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:30.220889 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:30.221211 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:30.221444 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:30.222103 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81746) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 15:45:30.222407 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:30.225242 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:30.261837 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1143/2280] 10.222.0.55 () {58 vars in 1153 bytes} [Thu Sep 1 15:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 15:45:30.263996 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4158316-1579-44f5-8142-845ba9fea2da None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:30.277572 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4158316-1579-44f5-8142-845ba9fea2da None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:30.296893 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985fa3a-579e-4655-a702-e4f2d47bc165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:30.297823 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985fa3a-579e-4655-a702-e4f2d47bc165 admin admin] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:30.298378 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985fa3a-579e-4655-a702-e4f2d47bc165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:30.298849 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985fa3a-579e-4655-a702-e4f2d47bc165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:30.299711 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985fa3a-579e-4655-a702-e4f2d47bc165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:30.301844 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985fa3a-579e-4655-a702-e4f2d47bc165 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:30.446696 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1138/2281] 10.222.0.55 () {60 vars in 1153 bytes} [Thu Sep 1 15:45:30 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:30.500279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:30.528604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e5a23-c4df-4c9f-9c14-bd58e99caad7 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:30.809813 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69accc0-1094-4956-b165-dc5eb749abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:30.810532 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69accc0-1094-4956-b165-dc5eb749abf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:30.810816 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69accc0-1094-4956-b165-dc5eb749abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:30.811095 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69accc0-1094-4956-b165-dc5eb749abf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:30.811750 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69accc0-1094-4956-b165-dc5eb749abf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:30.813734 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69accc0-1094-4956-b165-dc5eb749abf4 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:30.899356 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1144/2282] 10.222.0.55 () {60 vars in 1144 bytes} [Thu Sep 1 15:45:30 2022] POST /identity/v3/users => generated 282 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 15:45:30.903499 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985fa3a-579e-4655-a702-e4f2d47bc165 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:30.932942 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985fa3a-579e-4655-a702-e4f2d47bc165 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:30.954231 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56122135-1504-45c2-ae9f-5280f5d3c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:30.955391 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122135-1504-45c2-ae9f-5280f5d3c70e admin admin] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:30.955952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122135-1504-45c2-ae9f-5280f5d3c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:30.956504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122135-1504-45c2-ae9f-5280f5d3c70e admin admin] PATH_INFO: `/v3/roles` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:30.959162 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56122135-1504-45c2-ae9f-5280f5d3c70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:30.965489 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56122135-1504-45c2-ae9f-5280f5d3c70e admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:30.993034 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1139/2283] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:30.997346 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69accc0-1094-4956-b165-dc5eb749abf4 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:31.017220 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69accc0-1094-4956-b165-dc5eb749abf4 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:31.064476 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8bd89-eb1f-451c-8260-28619346aac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:31.065106 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8bd89-eb1f-451c-8260-28619346aac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:31.065393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8bd89-eb1f-451c-8260-28619346aac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:31.071567 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8bd89-eb1f-451c-8260-28619346aac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:31.074720 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8bd89-eb1f-451c-8260-28619346aac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:31.080520 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8bd89-eb1f-451c-8260-28619346aac0 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:31.135184 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1145/2284] 10.222.0.55 () {58 vars in 1122 bytes} [Thu Sep 1 15:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 15:45:31.135657 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56122135-1504-45c2-ae9f-5280f5d3c70e admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:31.149573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:31.161705 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56122135-1504-45c2-ae9f-5280f5d3c70e admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:31.176163 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:31.177981 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:31.178202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:31.178483 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] PATH_INFO: `/v3/projects/cf663f9f868e4d139c975f36674c4cd1/users/168bcdf01cab4182bcdbd4c478bb35bb/roles/4367ece899d646eeb2e2917530897f7f` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:31.225105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf663f9f868e4d139c975f36674c4cd1, user_id=168bcdf01cab4182bcdbd4c478bb35bb, role_id=4367ece899d646eeb2e2917530897f7f)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:31.233076 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:31.267830 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1140/2285] 10.222.0.55 () {60 vars in 1483 bytes} [Thu Sep 1 15:45:31 2022] PUT /identity/v3/projects/cf663f9f868e4d139c975f36674c4cd1/users/168bcdf01cab4182bcdbd4c478bb35bb/roles/4367ece899d646eeb2e2917530897f7f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:45:31.279025 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf39a3-4fb8-4b5a-bd85-26ab5a6ec66d None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:31.280082 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf39a3-4fb8-4b5a-bd85-26ab5a6ec66d None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:31.280598 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf39a3-4fb8-4b5a-bd85-26ab5a6ec66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:31.327357 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-3ccf39a3-4fb8-4b5a-bd85-26ab5a6ec66d None None] MFA Rules not processed for user `168bcdf01cab4182bcdbd4c478bb35bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:31.329482 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3ccf39a3-4fb8-4b5a-bd85-26ab5a6ec66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:31.441966 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1146/2286] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:45:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 15:45:31.467416 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:31.469250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:31.632545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fef2a9-bdd0-448f-8689-51d5b22fb227 admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:31.650937 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d6e4b-7a49-4909-a51d-07a143ff6844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9abba87fe6b44e5850d79dbd8d52469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:31.651679 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d6e4b-7a49-4909-a51d-07a143ff6844 service cinder] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:31.652056 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d6e4b-7a49-4909-a51d-07a143ff6844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:31.652406 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d6e4b-7a49-4909-a51d-07a143ff6844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:31.673768 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d6e4b-7a49-4909-a51d-07a143ff6844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:31.675804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d6e4b-7a49-4909-a51d-07a143ff6844 service cinder] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:31.698138 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1141/2287] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:41.434323 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:41.688713 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:45:48.827345 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf39a3-4fb8-4b5a-bd85-26ab5a6ec66d None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:48.828982 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-3ccf39a3-4fb8-4b5a-bd85-26ab5a6ec66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:49.013400 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf39a3-4fb8-4b5a-bd85-26ab5a6ec66d None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:49.043263 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276438b-9212-486c-935a-05fc7d02baed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ee78db03794fbcb572ca1e98f231fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:49.044701 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276438b-9212-486c-935a-05fc7d02baed service placement] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:49.045014 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276438b-9212-486c-935a-05fc7d02baed service placement] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:49.045362 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276438b-9212-486c-935a-05fc7d02baed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:49.051137 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-8276438b-9212-486c-935a-05fc7d02baed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:49.075239 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276438b-9212-486c-935a-05fc7d02baed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:49.077885 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276438b-9212-486c-935a-05fc7d02baed service placement] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:49.101078 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1147/2288] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:54.061177 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67f26-2f52-4f32-a789-26644a826b02 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.061774 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67f26-2f52-4f32-a789-26644a826b02 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.062477 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67f26-2f52-4f32-a789-26644a826b02 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.064225 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1142/2289] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:45:54.072690 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e691-b262-4255-b4e3-82873098aeae None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.073279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e691-b262-4255-b4e3-82873098aeae None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.073279 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e691-b262-4255-b4e3-82873098aeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.095560 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-5c87e691-b262-4255-b4e3-82873098aeae None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:54.096821 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-5c87e691-b262-4255-b4e3-82873098aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:54.178269 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1148/2290] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:45:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:54.190486 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67f26-2f52-4f32-a789-26644a826b02 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:54.192186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-afe67f26-2f52-4f32-a789-26644a826b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:54.251208 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67f26-2f52-4f32-a789-26644a826b02 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:54.255186 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6642c3-86b1-40b8-a029-f0ae8d38c209 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df1a3f053649456d982dd6c2d45d23c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:54.255846 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6642c3-86b1-40b8-a029-f0ae8d38c209 service glance] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.256156 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6642c3-86b1-40b8-a029-f0ae8d38c209 service glance] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.256451 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6642c3-86b1-40b8-a029-f0ae8d38c209 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.267214 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6642c3-86b1-40b8-a029-f0ae8d38c209 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:54.268751 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6642c3-86b1-40b8-a029-f0ae8d38c209 service glance] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:54.279355 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1143/2291] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:54.350753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef19b4-ae5a-456f-89d8-950e940ee133 None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.351174 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef19b4-ae5a-456f-89d8-950e940ee133 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.351313 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef19b4-ae5a-456f-89d8-950e940ee133 None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.353030 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1149/2292] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:45:54.362105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace51f-a6f0-4a58-8732-43854531a10b None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.362393 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace51f-a6f0-4a58-8732-43854531a10b None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.362665 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace51f-a6f0-4a58-8732-43854531a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.383423 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-cdace51f-a6f0-4a58-8732-43854531a10b None None] MFA Rules not processed for user `0319076e113748d4a86e5906559abdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:54.384628 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-cdace51f-a6f0-4a58-8732-43854531a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:54.445117 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1144/2293] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:45:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:54.457563 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef19b4-ae5a-456f-89d8-950e940ee133 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:54.459293 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-24ef19b4-ae5a-456f-89d8-950e940ee133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:54.472327 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef19b4-ae5a-456f-89d8-950e940ee133 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:54.475873 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31a012-a966-4867-858a-54431dfd2f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:54.476471 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a012-a966-4867-858a-54431dfd2f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.476753 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a012-a966-4867-858a-54431dfd2f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.477015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a012-a966-4867-858a-54431dfd2f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.484231 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31a012-a966-4867-858a-54431dfd2f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:54.485649 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31a012-a966-4867-858a-54431dfd2f2b service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:54.495584 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1150/2294] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:54.586852 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80b02e-9b6c-45ad-9131-a360320fc1b8 None None] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.587144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80b02e-9b6c-45ad-9131-a360320fc1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.587427 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80b02e-9b6c-45ad-9131-a360320fc1b8 None None] PATH_INFO: `/` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.588918 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1145/2295] 10.222.0.55 () {54 vars in 921 bytes} [Thu Sep 1 15:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:45:54.594328 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304fe8e-2576-4855-a2fd-5d5ffa184796 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.594619 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304fe8e-2576-4855-a2fd-5d5ffa184796 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.594895 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304fe8e-2576-4855-a2fd-5d5ffa184796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.616015 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-4304fe8e-2576-4855-a2fd-5d5ffa184796 None None] MFA Rules not processed for user `9fbf473d168b4c9692f75a51c84b7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:54.617214 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4304fe8e-2576-4855-a2fd-5d5ffa184796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:54.626655 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1151/2296] 10.222.0.55 () {58 vars in 1018 bytes} [Thu Sep 1 15:45:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:54.637161 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80b02e-9b6c-45ad-9131-a360320fc1b8 None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:54.649223 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80b02e-9b6c-45ad-9131-a360320fc1b8 None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:54.652952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:54.653576 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:54.653854 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:54.654128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:54.665415 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:54.666859 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:54.677590 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1146/2297] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:45:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:45:59.329333 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c964cf1-6f9e-4499-a0b3-d979aaf67fc5 None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:59.329868 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c964cf1-6f9e-4499-a0b3-d979aaf67fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:59.330144 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c964cf1-6f9e-4499-a0b3-d979aaf67fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:59.352968 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-9c964cf1-6f9e-4499-a0b3-d979aaf67fc5 None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:45:59.354219 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-9c964cf1-6f9e-4499-a0b3-d979aaf67fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:59.432512 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1152/2298] 10.222.0.55 () {58 vars in 1009 bytes} [Thu Sep 1 15:45:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:45:59.455246 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:45:59.456803 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:45:59.534050 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2aa0b-fe80-4333-b5f5-6c63a53b97ee service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:45:59.540870 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dad79-94c2-4549-be58-1921c3cfc0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:45:59.541584 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dad79-94c2-4549-be58-1921c3cfc0e9 service swift] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:45:59.541869 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dad79-94c2-4549-be58-1921c3cfc0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:45:59.542146 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dad79-94c2-4549-be58-1921c3cfc0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:45:59.551402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dad79-94c2-4549-be58-1921c3cfc0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:45:59.553676 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dad79-94c2-4549-be58-1921c3cfc0e9 service swift] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:45:59.563210 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1147/2299] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:45:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:46:09.425283 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=97 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:09.558649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=87 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:11.265733 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c964cf1-6f9e-4499-a0b3-d979aaf67fc5 None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:11.331277 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c964cf1-6f9e-4499-a0b3-d979aaf67fc5 None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:11.336706 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:11.337581 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:11.337963 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:11.338338 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] PATH_INFO: `/v3/users/168bcdf01cab4182bcdbd4c478bb35bb` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:11.339717 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=168bcdf01cab4182bcdbd4c478bb35bb)` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:11.342383 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:11.393571 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168bcdf01cab4182bcdbd4c478bb35bb'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.401180 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168bcdf01cab4182bcdbd4c478bb35bb'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.408545 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168bcdf01cab4182bcdbd4c478bb35bb'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.409160 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168bcdf01cab4182bcdbd4c478bb35bb'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.421744 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.notifications [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168bcdf01cab4182bcdbd4c478bb35bb'} {{(pid=81746) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.427605 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1153/2300] 10.222.0.55 () {58 vars in 1224 bytes} [Thu Sep 1 15:46:11 2022] DELETE /identity/v3/users/168bcdf01cab4182bcdbd4c478bb35bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:46:11.432065 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f4152-b0d8-41b4-9a1e-d8b867cbbaee None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:11.432545 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f4152-b0d8-41b4-9a1e-d8b867cbbaee None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:11.432649 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f4152-b0d8-41b4-9a1e-d8b867cbbaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:11.451456 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-534f4152-b0d8-41b4-9a1e-d8b867cbbaee None None] MFA Rules not processed for user `4c5eeca39d48419987d8ddcfee675e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:11.453833 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-534f4152-b0d8-41b4-9a1e-d8b867cbbaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:11.512951 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1148/2301] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:11.523393 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:11.524910 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:11.581399 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864578f7-55c8-4672-a4a1-2bca01a527b3 admin admin] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:11.584922 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187d46-9f1b-4ec7-b9b1-88d5cfba0de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:11.585526 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187d46-9f1b-4ec7-b9b1-88d5cfba0de4 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:11.585805 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187d46-9f1b-4ec7-b9b1-88d5cfba0de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:11.586075 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187d46-9f1b-4ec7-b9b1-88d5cfba0de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:11.594948 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2187d46-9f1b-4ec7-b9b1-88d5cfba0de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:11.596427 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2187d46-9f1b-4ec7-b9b1-88d5cfba0de4 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:11.605770 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1154/2302] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 15:46:11.882621 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f4152-b0d8-41b4-9a1e-d8b867cbbaee None None] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:11.884128 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-534f4152-b0d8-41b4-9a1e-d8b867cbbaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:11.898139 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f4152-b0d8-41b4-9a1e-d8b867cbbaee None None] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:11.903240 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c5eeca39d48419987d8ddcfee675e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f1f2851042af834bdbb9f604e393', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:11.904110 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:11.904388 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:11.904697 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] PATH_INFO: `/v3/projects/cf663f9f868e4d139c975f36674c4cd1` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:11.905762 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf663f9f868e4d139c975f36674c4cd1)` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:11.907858 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:11.957744 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf663f9f868e4d139c975f36674c4cd1', 'request_id': 'req-0e6e71ef-3fa5-4ab8-9929-acb29875120f'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.964698 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf663f9f868e4d139c975f36674c4cd1', 'request_id': 'req-0e6e71ef-3fa5-4ab8-9929-acb29875120f'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.970940 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf663f9f868e4d139c975f36674c4cd1', 'request_id': 'req-0e6e71ef-3fa5-4ab8-9929-acb29875120f'} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.983629 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] The token cache is being invalidate because project cf663f9f868e4d139c975f36674c4cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 15:46:11.983958 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.984589 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.notifications [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 15:46:11.986105 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1149/2303] 10.222.0.55 () {58 vars in 1233 bytes} [Thu Sep 1 15:46:11 2022] DELETE /identity/v3/projects/cf663f9f868e4d139c975f36674c4cd1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 15:46:13.285298 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187d46-9f1b-4ec7-b9b1-88d5cfba0de4 service neutron] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:13.295624 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187d46-9f1b-4ec7-b9b1-88d5cfba0de4 service neutron] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:13.314849 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:13.348502 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fff16-ee12-436d-9d05-fb99765acc25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:13.349146 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fff16-ee12-436d-9d05-fb99765acc25 service neutron] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:13.349432 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fff16-ee12-436d-9d05-fb99765acc25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:13.350266 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fff16-ee12-436d-9d05-fb99765acc25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:13.352064 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-4b1fff16-ee12-436d-9d05-fb99765acc25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:13.423321 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fff16-ee12-436d-9d05-fb99765acc25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:13.424801 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fff16-ee12-436d-9d05-fb99765acc25 service neutron] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:13.434402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1155/2304] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:18.874250 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:18.875961 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:18.888419 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e71ef-3fa5-4ab8-9929-acb29875120f admin admin] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:18.891934 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:18.892530 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:18.892804 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:18.893102 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:18.894734 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:18.956090 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:18.957573 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:18.967840 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1150/2305] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:46:23.430097 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=40 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:27.714351 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7581-50f5-40a5-9f43-7534066f418a None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:27.714974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7581-50f5-40a5-9f43-7534066f418a None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:27.714974 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7581-50f5-40a5-9f43-7534066f418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:27.734209 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-891c7581-50f5-40a5-9f43-7534066f418a None None] MFA Rules not processed for user `7eaff7a61225436bb9e100b03f56441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:27.735418 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-891c7581-50f5-40a5-9f43-7534066f418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:27.794470 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1156/2306] 10.222.0.55 () {58 vars in 967 bytes} [Thu Sep 1 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:27.806952 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:46:27.808444 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:27.829728 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:27.889193 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1231-4df4-492e-af0d-e6acd8938895 service neutron] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:46:27.894504 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7749a7a-ab21-493d-9025-506c6a805114 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0df2e3dd45c43c5a6f10c28479732b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:46:27.895120 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7749a7a-ab21-493d-9025-506c6a805114 service swift] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:27.895402 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7749a7a-ab21-493d-9025-506c6a805114 service swift] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:27.895735 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7749a7a-ab21-493d-9025-506c6a805114 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:27.905901 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7749a7a-ab21-493d-9025-506c6a805114 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:46:27.907503 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7749a7a-ab21-493d-9025-506c6a805114 service swift] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:46:27.915745 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1151/2307] 10.222.0.55 () {60 vars in 1384 bytes} [Thu Sep 1 15:46:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 15:46:37.786871 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=25 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:37.912555 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=24 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:46:47.626705 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317977-8d7e-4969-81af-1577c8ff5f1b None None] REQUEST_METHOD: `POST` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:46:47.627205 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317977-8d7e-4969-81af-1577c8ff5f1b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:46:47.627303 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317977-8d7e-4969-81af-1577c8ff5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:46:47.647363 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.auth.core [None req-16317977-8d7e-4969-81af-1577c8ff5f1b None None] MFA Rules not processed for user `074e13c753f047968b2560b12d4b53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81746) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:46:47.648604 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-16317977-8d7e-4969-81af-1577c8ff5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:46:47.702684 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1157/2308] 10.222.0.55 () {58 vars in 958 bytes} [Thu Sep 1 15:46:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:46:57.696111 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=25 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:48:51.797458 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7749a7a-ab21-493d-9025-506c6a805114 service swift] Authenticating user token {{(pid=81745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:48:51.806817 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7749a7a-ab21-493d-9025-506c6a805114 service swift] Validating token access rules against request {{(pid=81745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:48:51.810438 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059d64c-0f23-4188-b2ac-f59ab7fbfb82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0319076e113748d4a86e5906559abdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:48:51.811031 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d64c-0f23-4188-b2ac-f59ab7fbfb82 service neutron] REQUEST_METHOD: `GET` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:48:51.811311 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d64c-0f23-4188-b2ac-f59ab7fbfb82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:48:51.811586 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d64c-0f23-4188-b2ac-f59ab7fbfb82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:48:51.813348 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-7059d64c-0f23-4188-b2ac-f59ab7fbfb82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:48:51.823204 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059d64c-0f23-4188-b2ac-f59ab7fbfb82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:48:51.824674 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059d64c-0f23-4188-b2ac-f59ab7fbfb82 service neutron] RBAC: Authorization granted {{(pid=81745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:48:51.833150 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1152/2309] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:48:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:49:01.828998 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=6 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:50:51.533786 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f971a-de10-4659-88c3-50633c726c0b None None] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:50:51.534270 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f971a-de10-4659-88c3-50633c726c0b None None] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:50:51.534377 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f971a-de10-4659-88c3-50633c726c0b None None] PATH_INFO: `/` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:50:51.535656 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1158/2310] 10.222.0.55 () {54 vars in 961 bytes} [Thu Sep 1 15:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 15:50:51.540662 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd297-fc2f-49e4-ba3c-3b4f5f1d2809 None None] REQUEST_METHOD: `POST` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:50:51.541096 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd297-fc2f-49e4-ba3c-3b4f5f1d2809 None None] SCRIPT_NAME: `/identity` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:50:51.541202 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cd297-fc2f-49e4-ba3c-3b4f5f1d2809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:50:51.619144 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.auth.core [None req-051cd297-fc2f-49e4-ba3c-3b4f5f1d2809 None None] MFA Rules not processed for user `99ee78db03794fbcb572ca1e98f231fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 15:50:51.620382 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG keystone.common.fernet_utils [None req-051cd297-fc2f-49e4-ba3c-3b4f5f1d2809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:50:51.729639 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: [pid: 81745|app: 0|req: 1153/2311] 10.222.0.55 () {58 vars in 1058 bytes} [Thu Sep 1 15:50:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 15:50:51.737347 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f971a-de10-4659-88c3-50633c726c0b None None] Authenticating user token {{(pid=81746) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 15:50:51.751402 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f971a-de10-4659-88c3-50633c726c0b None None] Validating token access rules against request {{(pid=81746) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 15:50:51.756295 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b68750-fcc6-4f0e-b499-2a6b4f4ea087 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99ee78db03794fbcb572ca1e98f231fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab172e9e6ef64f71bac198db64a713e9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81746) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 15:50:51.756882 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68750-fcc6-4f0e-b499-2a6b4f4ea087 service placement] REQUEST_METHOD: `GET` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 15:50:51.757161 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68750-fcc6-4f0e-b499-2a6b4f4ea087 service placement] SCRIPT_NAME: `/identity` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 15:50:51.757430 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68750-fcc6-4f0e-b499-2a6b4f4ea087 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81746) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 15:50:51.759138 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.fernet_utils [None req-d1b68750-fcc6-4f0e-b499-2a6b4f4ea087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81746) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 15:50:51.771164 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b68750-fcc6-4f0e-b499-2a6b4f4ea087 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 15:50:51.772807 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b68750-fcc6-4f0e-b499-2a6b4f4ea087 service placement] RBAC: Authorization granted {{(pid=81746) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 15:50:51.782833 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: [pid: 81746|app: 0|req: 1159/2312] 10.222.0.55 () {60 vars in 1365 bytes} [Thu Sep 1 15:50:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 15:51:01.727660 dv-cinder-852210-8-iscsi devstack@keystone.service[81745]: DEBUG dbcounter [-] [81745] Writing DB stats keystone:SELECT=74 {{(pid=81745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:51:01.778531 dv-cinder-852210-8-iscsi devstack@keystone.service[81746]: DEBUG dbcounter [-] [81746] Writing DB stats keystone:SELECT=6 {{(pid=81746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}